Apr 12 09:04:35 user nova-compute[71482]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 12 09:04:37 user nova-compute[71482]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71482) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 09:04:37 user nova-compute[71482]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71482) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 09:04:37 user nova-compute[71482]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71482) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 12 09:04:37 user nova-compute[71482]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 12 09:04:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:04:38 user nova-compute[71482]: INFO nova.virt.driver [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 12 09:04:38 user nova-compute[71482]: INFO nova.compute.provider_config [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] Acquiring lock "singleton_lock" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] Acquired lock "singleton_lock" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] Releasing lock "singleton_lock" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] Full set of CONF: {{(pid=71482) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ******************************************************************************** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] Configuration options gathered from: {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ================================================================================ {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] allow_resize_to_same_host      = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] arq_binding_timeout            = 300 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] backdoor_port                  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] backdoor_socket                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] block_device_allocate_retries  = 300 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] block_device_allocate_retries_interval = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cert                           = self.pem {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute_monitors               = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] config_dir                     = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] config_drive_format            = iso9660 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] config_source                  = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] console_host                   = user {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] control_exchange               = nova {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cpu_allocation_ratio           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] daemon                         = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] debug                          = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] default_access_ip_network_name = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] default_availability_zone      = nova {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] default_ephemeral_format       = ext4 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] default_schedule_zone          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] disk_allocation_ratio          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] enable_new_services            = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] enabled_ssl_apis               = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] flat_injected                  = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] force_config_drive             = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] force_raw_images               = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] graceful_shutdown_timeout      = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] heal_instance_info_cache_interval = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] host                           = user {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] instance_build_timeout         = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] instance_delete_interval       = 300 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] instance_name_template         = instance-%08x {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] instance_usage_audit           = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] instance_usage_audit_period    = month {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] internal_service_availability_zone = internal {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] key                            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] live_migration_retry_count     = 30 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] log_config_append              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] log_dir                        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] log_file                       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] log_options                    = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] log_rotate_interval            = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] log_rotate_interval_type       = days {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] log_rotation_type              = none {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] long_rpc_timeout               = 1800 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] max_concurrent_builds          = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] max_concurrent_live_migrations = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] max_concurrent_snapshots       = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] max_local_block_devices        = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] max_logfile_count              = 30 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] max_logfile_size_mb            = 200 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] maximum_instance_delete_attempts = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] metadata_listen                = 0.0.0.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] metadata_listen_port           = 8775 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] metadata_workers               = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] migrate_max_retries            = -1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] mkisofs_cmd                    = genisoimage {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] my_ip                          = 10.0.0.210 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] network_allocate_retries       = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] osapi_compute_listen_port      = 8774 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] osapi_compute_unique_server_name_scope =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] osapi_compute_workers          = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] password_length                = 12 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] periodic_enable                = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] periodic_fuzzy_delay           = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] pointer_model                  = ps2mouse {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] preallocate_images             = none {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] publish_errors                 = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] pybasedir                      = /opt/stack/nova {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ram_allocation_ratio           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] rate_limit_burst               = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] rate_limit_except_level        = CRITICAL {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] rate_limit_interval            = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] reboot_timeout                 = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] reclaim_instance_interval      = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] record                         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] reimage_timeout_per_gb         = 20 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] report_interval                = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] rescue_timeout                 = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] reserved_host_cpus             = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] reserved_host_disk_mb          = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] reserved_host_memory_mb        = 512 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] reserved_huge_pages            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] resize_confirm_window          = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] resize_fs_using_block_device   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] resume_guests_state_on_host_boot = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] rpc_response_timeout           = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] run_external_periodic_tasks    = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] running_deleted_instance_action = reap {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] running_deleted_instance_timeout = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler_instance_sync_interval = 120 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_down_time              = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] servicegroup_driver            = db {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] shelved_offload_time           = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] shelved_poll_interval          = 3600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] shutdown_timeout               = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] source_is_ipv6                 = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ssl_only                       = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] state_path                     = /opt/stack/data/nova {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] sync_power_state_interval      = 600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] sync_power_state_pool_size     = 1000 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] syslog_log_facility            = LOG_USER {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] tempdir                        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] timeout_nbd                    = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] transport_url                  = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] update_resources_interval      = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] use_cow_images                 = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] use_eventlog                   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] use_journal                    = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] use_json                       = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] use_rootwrap_daemon            = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] use_stderr                     = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] use_syslog                     = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vcpu_pin_set                   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plugging_is_fatal          = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plugging_timeout           = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] virt_mkfs                      = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] volume_usage_poll_interval     = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] watch_log_file                 = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] web                            = /usr/share/spice-html5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_concurrency.disable_process_locking = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.auth_strategy              = keystone {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.compute_link_prefix        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.dhcp_domain                = novalocal {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.enable_instance_password   = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.glance_link_prefix         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.instance_list_per_project_cells = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.list_records_by_skipping_down_cells = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.local_metadata_per_cell    = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.max_limit                  = 1000 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.metadata_cache_expiration  = 15 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.neutron_default_tenant_id  = default {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.use_forwarded_for          = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.use_neutron_default_nets   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.vendordata_dynamic_targets = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.vendordata_jsonfile_path   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.backend_argument         = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.config_prefix            = cache.oslo {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.dead_timeout             = 60.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.debug_cache_backend      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.enable_retry_client      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.enable_socket_keepalive  = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.enabled                  = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.expiration_time          = 600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.hashclient_retry_attempts = 2 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_dead_retry      = 300 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_password        =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_sasl_enabled    = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.memcache_username        =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.proxies                  = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.retry_attempts           = 2 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.retry_delay              = 0.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.socket_keepalive_count   = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.socket_keepalive_idle    = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.socket_keepalive_interval = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.tls_allowed_ciphers      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.tls_cafile               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.tls_certfile             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.tls_enabled              = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cache.tls_keyfile              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.auth_section            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.auth_type               = password {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.cafile                  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.certfile                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.collect_timing          = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.cross_az_attach         = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.debug                   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.endpoint_template       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.http_retries            = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.insecure                = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.keyfile                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.os_region_name          = RegionOne {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.split_loggers           = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cinder.timeout                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.cpu_dedicated_set      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.cpu_shared_set         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.image_type_exclude_list = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.resource_provider_association_refresh = 300 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.shutdown_retry_interval = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] conductor.workers              = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] console.allowed_origins        = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] console.ssl_ciphers            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] console.ssl_minimum_version    = default {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] consoleauth.token_ttl          = 600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.cafile                  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.certfile                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.collect_timing          = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.connect_retries         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.connect_retry_delay     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.endpoint_override       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.insecure                = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.keyfile                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.max_version             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.min_version             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.region_name             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.service_name            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.service_type            = accelerator {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.split_loggers           = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.status_code_retries     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.status_code_retry_delay = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.timeout                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] cyborg.version                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.backend               = sqlalchemy {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.connection            = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.connection_debug      = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.connection_parameters =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.connection_recycle_time = 3600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.connection_trace      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.db_inc_retry_interval = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.db_max_retries        = 20 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.db_max_retry_interval = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.db_retry_interval     = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.max_overflow          = 50 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.max_pool_size         = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.max_retries           = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.mysql_enable_ndb      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.mysql_wsrep_sync_wait = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.pool_timeout          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.retry_interval        = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.slave_connection      = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] database.sqlite_synchronous    = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.backend           = sqlalchemy {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.connection        = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.connection_debug  = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.connection_parameters =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.connection_recycle_time = 3600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.connection_trace  = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.db_inc_retry_interval = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.db_max_retries    = 20 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.db_max_retry_interval = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.db_retry_interval = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.max_overflow      = 50 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.max_pool_size     = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.max_retries       = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.mysql_enable_ndb  = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.pool_timeout      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.retry_interval    = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.slave_connection  = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] api_database.sqlite_synchronous = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] devices.enabled_mdev_types     = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ephemeral_storage_encryption.enabled = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.api_servers             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.cafile                  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.certfile                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.collect_timing          = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.connect_retries         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.connect_retry_delay     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.debug                   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.default_trusted_certificate_ids = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.enable_certificate_validation = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.enable_rbd_download     = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.endpoint_override       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.insecure                = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.keyfile                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.max_version             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.min_version             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.num_retries             = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.rbd_ceph_conf           =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.rbd_connect_timeout     = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.rbd_pool                =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.rbd_user                =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.region_name             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.service_name            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.service_type            = image {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.split_loggers           = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.status_code_retries     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.status_code_retry_delay = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.timeout                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.verify_glance_signatures = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] glance.version                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] guestfs.debug                  = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.config_drive_cdrom      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.config_drive_inject_password = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.enable_remotefx         = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.instances_path_share    =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.limit_cpu_features      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.use_multipath_io        = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.vswitch_name            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] mks.enabled                    = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] image_cache.manager_interval   = 2400 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] image_cache.precache_concurrency = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] image_cache.remove_unused_base_images = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] image_cache.subdirectory_name  = _base {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.api_max_retries         = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.api_retry_interval      = 2 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.auth_section            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.auth_type               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.cafile                  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.certfile                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.collect_timing          = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.connect_retries         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.connect_retry_delay     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.endpoint_override       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.insecure                = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.keyfile                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.max_version             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.min_version             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.partition_key           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.peer_list               = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.region_name             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.serial_console_state_timeout = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.service_name            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.service_type            = baremetal {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.split_loggers           = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.status_code_retries     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.status_code_retry_delay = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.timeout                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ironic.version                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] key_manager.fixed_key          = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.barbican_api_version  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.barbican_endpoint     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.barbican_endpoint_type = public {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.barbican_region_name  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.cafile                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.certfile              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.collect_timing        = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.insecure              = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.keyfile               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.number_of_retries     = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.retry_delay           = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.send_service_user_token = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.split_loggers         = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.timeout               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.verify_ssl            = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican.verify_ssl_path       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican_service_user.auth_section = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican_service_user.auth_type = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican_service_user.cafile   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican_service_user.certfile = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican_service_user.collect_timing = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican_service_user.insecure = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican_service_user.keyfile  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican_service_user.split_loggers = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] barbican_service_user.timeout  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.approle_role_id          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.approle_secret_id        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.cafile                   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.certfile                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.collect_timing           = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.insecure                 = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.keyfile                  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.kv_mountpoint            = secret {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.kv_version               = 2 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.namespace                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.root_token_id            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.split_loggers            = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.ssl_ca_crt_file          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.timeout                  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.use_ssl                  = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.cafile                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.certfile              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.collect_timing        = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.connect_retries       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.connect_retry_delay   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.endpoint_override     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.insecure              = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.keyfile               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.max_version           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.min_version           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.region_name           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.service_name          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.service_type          = identity {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.split_loggers         = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.status_code_retries   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.status_code_retry_delay = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.timeout               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] keystone.version               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.connection_uri         =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.cpu_mode               = custom {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: WARNING oslo_config.cfg [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.cpu_power_governor_high = performance {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.cpu_power_management   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.device_detach_attempts = 8 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.device_detach_timeout  = 20 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.disk_cachemodes        = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.disk_prefix            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.enabled_perf_events    = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.file_backed_memory     = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.gid_maps               = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.hw_disk_discard        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.hw_machine_type        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.images_rbd_pool        = rbd {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.images_type            = default {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.images_volume_group    = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.inject_key             = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.inject_partition       = -2 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.inject_password        = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.iscsi_iface            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.iser_use_multipath     = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_downtime = 500 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_inbound_addr = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_scheme  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_timeout_action = abort {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_tunnelled = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: WARNING oslo_config.cfg [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 12 09:04:38 user nova-compute[71482]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 12 09:04:38 user nova-compute[71482]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 12 09:04:38 user nova-compute[71482]: and ``live_migration_inbound_addr`` respectively.
Apr 12 09:04:38 user nova-compute[71482]: ).  Its value may be silently ignored in the future.
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.live_migration_with_native_tls = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.max_queues             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.nfs_mount_options      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.num_pcie_ports         = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.pmem_namespaces        = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.quobyte_client_cfg     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rbd_secret_uuid        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rbd_user               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rescue_image_id        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rescue_kernel_id       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.rx_queue_size          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.smbfs_mount_options    =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.snapshot_compression   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.snapshot_image_format  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.sparse_logical_volumes = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.swtpm_enabled          = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.swtpm_group            = tss {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.swtpm_user             = tss {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.sysinfo_serial         = unique {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.tx_queue_size          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.uid_maps               = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.use_virtio_for_bridges = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.virt_type              = kvm {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.volume_clear           = zero {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.volume_clear_size      = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.volume_use_multipath   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.vzstorage_cache_path   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.auth_section           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.auth_type              = password {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.cafile                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.certfile               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.collect_timing         = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.connect_retries        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.connect_retry_delay    = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.default_floating_pool  = public {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.endpoint_override      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.extension_sync_interval = 600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.http_retries           = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.insecure               = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.keyfile                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.max_version            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.min_version            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.ovs_bridge             = br-int {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.physnets               = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.region_name            = RegionOne {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.service_metadata_proxy = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.service_name           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.service_type           = network {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.split_loggers          = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.status_code_retries    = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.status_code_retry_delay = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.timeout                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] neutron.version                = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] notifications.bdms_in_notifications = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] notifications.default_level    = INFO {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] notifications.notification_format = unversioned {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] notifications.notify_on_state_change = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] pci.alias                      = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] pci.device_spec                = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] pci.report_in_placement        = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.auth_section         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.auth_type            = password {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.cafile               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.certfile             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.collect_timing       = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.connect_retries      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.connect_retry_delay  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.default_domain_id    = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.default_domain_name  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.domain_id            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.domain_name          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.endpoint_override    = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.insecure             = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.keyfile              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.max_version          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.min_version          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.password             = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.project_domain_id    = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.project_domain_name  = Default {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.project_id           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.project_name         = service {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.region_name          = RegionOne {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.service_name         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.service_type         = placement {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.split_loggers        = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.status_code_retries  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.status_code_retry_delay = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.system_scope         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.timeout              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.trust_id             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.user_domain_id       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.user_domain_name     = Default {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.user_id              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.username             = placement {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] placement.version              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.cores                    = 20 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.count_usage_from_placement = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.injected_file_content_bytes = 10240 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.injected_file_path_length = 255 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.injected_files           = 5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.instances                = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.key_pairs                = 100 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.metadata_items           = 128 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.ram                      = 51200 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.recheck_quota            = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.server_group_members     = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] quota.server_groups            = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] rdp.enabled                    = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.image_metadata_prefilter = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.max_attempts         = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.max_placement_results = 1000 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] scheduler.workers              = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.host_subset_size = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.isolated_hosts = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.isolated_images = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.pci_in_placement = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.track_instance_changes = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] metrics.required               = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] metrics.weight_multiplier      = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] metrics.weight_setting         = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] serial_console.enabled         = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] serial_console.port_range      = 10000:20000 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] serial_console.serialproxy_port = 6083 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.auth_section      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.auth_type         = password {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.cafile            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.certfile          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.collect_timing    = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.insecure          = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.keyfile           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.send_service_user_token = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.split_loggers     = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] service_user.timeout           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.agent_enabled            = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.enabled                  = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.html5proxy_port          = 6082 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.image_compression        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.jpeg_compression         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.playback_compression     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.server_listen            = 127.0.0.1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.streaming_mode           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] spice.zlib_compression         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] upgrade_levels.baseapi         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] upgrade_levels.cert            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] upgrade_levels.compute         = auto {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] upgrade_levels.conductor       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] upgrade_levels.scheduler       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vendordata_dynamic_auth.cafile = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vendordata_dynamic_auth.certfile = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vendordata_dynamic_auth.insecure = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vendordata_dynamic_auth.timeout = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.api_retry_count         = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.ca_file                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.cache_prefix            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.cluster_name            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.connection_pool_size    = 10 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.console_delay_seconds   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.datastore_regex         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.host_ip                 = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.host_password           = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.host_port               = 443 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.host_username           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.insecure                = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.integration_bridge      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.maximum_objects         = 100 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.pbm_default_policy      = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.pbm_enabled             = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.pbm_wsdl_location       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.serial_port_proxy_uri   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.serial_port_service_uri = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.task_poll_interval      = 0.5 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.use_linked_clone        = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.vnc_keymap              = en-us {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.vnc_port                = 5900 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vmware.vnc_port_total          = 10000 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.auth_schemes               = ['none'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.enabled                    = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.novncproxy_port            = 6080 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.vencrypt_ca_certs          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.vencrypt_client_cert       = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vnc.vencrypt_client_key        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.disable_rootwrap   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.enable_numa_live_migration = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.libvirt_disable_apic = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.client_socket_timeout     = 900 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.default_pool_size         = 1000 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.keep_alive                = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.max_header_line           = 16384 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.ssl_ca_file               = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.ssl_cert_file             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.ssl_key_file              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.tcp_keepidle              = 600 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] zvm.ca_file                    = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] zvm.cloud_connector_url        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] zvm.reachable_timeout          = 300 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.enforce_new_defaults = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.enforce_scope      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.policy_default_rule = default {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.connection_string     = messaging:// {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.enabled               = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.es_doc_type           = notification {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.es_scroll_size        = 10000 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.es_scroll_time        = 2m {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.filter_error_trace    = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.sentinel_service_name = mymaster {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.socket_timeout        = 0.1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] profiler.trace_sqlalchemy      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] remote_debug.host              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] remote_debug.port              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_notifications.retry = -1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.auth_section        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.auth_type           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.cafile              = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.certfile            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.collect_timing      = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.connect_retries     = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.connect_retry_delay = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.endpoint_id         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.endpoint_override   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.insecure            = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.keyfile             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.max_version         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.min_version         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.region_name         = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.service_name        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.service_type        = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.split_loggers       = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.status_code_retries = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.status_code_retry_delay = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.timeout             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.valid_interfaces    = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_limit.version             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_reports.file_event_handler = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] oslo_reports.log_dir           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_ovs_privileged.group  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] vif_plug_ovs_privileged.user   = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_ovs.isolate_vif         = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] os_brick.lock_path             = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] privsep_osbrick.capabilities   = [21] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] privsep_osbrick.group          = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] privsep_osbrick.helper_command = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] privsep_osbrick.user           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] nova_sys_admin.group           = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] nova_sys_admin.helper_command  = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] nova_sys_admin.user            = None {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG oslo_service.service [None req-f23b5264-382d-4848-bb0a-58d1f784a270 None None] ******************************************************************************** {{(pid=71482) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 12 09:04:38 user nova-compute[71482]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 12 09:04:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Starting native event thread {{(pid=71482) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Starting green dispatch thread {{(pid=71482) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Starting connection event dispatch thread {{(pid=71482) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Connecting to libvirt: qemu:///system {{(pid=71482) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f9345ab6680> {{(pid=71482) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 12 09:04:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f9345ab6680> {{(pid=71482) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 12 09:04:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Connection event '1' reason 'None'
Apr 12 09:04:38 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 09:04:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.mount [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Initialising _HostMountState generation 0 {{(pid=71482) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 12 09:04:45 user nova-compute[71482]: INFO nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt host capabilities <capabilities>
Apr 12 09:04:45 user nova-compute[71482]:   <host>
Apr 12 09:04:45 user nova-compute[71482]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 12 09:04:45 user nova-compute[71482]:     <cpu>
Apr 12 09:04:45 user nova-compute[71482]:       <arch>x86_64</arch>
Apr 12 09:04:45 user nova-compute[71482]:       <model>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <vendor>Intel</vendor>
Apr 12 09:04:45 user nova-compute[71482]:       <microcode version='1070'/>
Apr 12 09:04:45 user nova-compute[71482]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 12 09:04:45 user nova-compute[71482]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='ss'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='vmx'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='pcid'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='osxsave'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='hypervisor'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='arat'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='tsc_adjust'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='md-clear'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='arch-capabilities'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='invtsc'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='rsba'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature name='skip-l1dfl-vmentry'/>
Apr 12 09:04:45 user nova-compute[71482]:       <pages unit='KiB' size='4'/>
Apr 12 09:04:45 user nova-compute[71482]:       <pages unit='KiB' size='2048'/>
Apr 12 09:04:45 user nova-compute[71482]:     </cpu>
Apr 12 09:04:45 user nova-compute[71482]:     <power_management>
Apr 12 09:04:45 user nova-compute[71482]:       <suspend_mem/>
Apr 12 09:04:45 user nova-compute[71482]:       <suspend_disk/>
Apr 12 09:04:45 user nova-compute[71482]:       <suspend_hybrid/>
Apr 12 09:04:45 user nova-compute[71482]:     </power_management>
Apr 12 09:04:45 user nova-compute[71482]:     <iommu support='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     <migration_features>
Apr 12 09:04:45 user nova-compute[71482]:       <live/>
Apr 12 09:04:45 user nova-compute[71482]:       <uri_transports>
Apr 12 09:04:45 user nova-compute[71482]:         <uri_transport>tcp</uri_transport>
Apr 12 09:04:45 user nova-compute[71482]:         <uri_transport>rdma</uri_transport>
Apr 12 09:04:45 user nova-compute[71482]:       </uri_transports>
Apr 12 09:04:45 user nova-compute[71482]:     </migration_features>
Apr 12 09:04:45 user nova-compute[71482]:     <topology>
Apr 12 09:04:45 user nova-compute[71482]:       <cells num='2'>
Apr 12 09:04:45 user nova-compute[71482]:         <cell id='0'>
Apr 12 09:04:45 user nova-compute[71482]:           <memory unit='KiB'>8152920</memory>
Apr 12 09:04:45 user nova-compute[71482]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 12 09:04:45 user nova-compute[71482]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 09:04:45 user nova-compute[71482]:           <distances>
Apr 12 09:04:45 user nova-compute[71482]:             <sibling id='0' value='10'/>
Apr 12 09:04:45 user nova-compute[71482]:             <sibling id='1' value='20'/>
Apr 12 09:04:45 user nova-compute[71482]:           </distances>
Apr 12 09:04:45 user nova-compute[71482]:           <cpus num='6'>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 12 09:04:45 user nova-compute[71482]:           </cpus>
Apr 12 09:04:45 user nova-compute[71482]:         </cell>
Apr 12 09:04:45 user nova-compute[71482]:         <cell id='1'>
Apr 12 09:04:45 user nova-compute[71482]:           <memory unit='KiB'>8255068</memory>
Apr 12 09:04:45 user nova-compute[71482]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 12 09:04:45 user nova-compute[71482]:           <pages unit='KiB' size='2048'>0</pages>
Apr 12 09:04:45 user nova-compute[71482]:           <distances>
Apr 12 09:04:45 user nova-compute[71482]:             <sibling id='0' value='20'/>
Apr 12 09:04:45 user nova-compute[71482]:             <sibling id='1' value='10'/>
Apr 12 09:04:45 user nova-compute[71482]:           </distances>
Apr 12 09:04:45 user nova-compute[71482]:           <cpus num='6'>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 12 09:04:45 user nova-compute[71482]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 12 09:04:45 user nova-compute[71482]:           </cpus>
Apr 12 09:04:45 user nova-compute[71482]:         </cell>
Apr 12 09:04:45 user nova-compute[71482]:       </cells>
Apr 12 09:04:45 user nova-compute[71482]:     </topology>
Apr 12 09:04:45 user nova-compute[71482]:     <cache>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 12 09:04:45 user nova-compute[71482]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 12 09:04:45 user nova-compute[71482]:     </cache>
Apr 12 09:04:45 user nova-compute[71482]:     <secmodel>
Apr 12 09:04:45 user nova-compute[71482]:       <model>apparmor</model>
Apr 12 09:04:45 user nova-compute[71482]:       <doi>0</doi>
Apr 12 09:04:45 user nova-compute[71482]:     </secmodel>
Apr 12 09:04:45 user nova-compute[71482]:     <secmodel>
Apr 12 09:04:45 user nova-compute[71482]:       <model>dac</model>
Apr 12 09:04:45 user nova-compute[71482]:       <doi>0</doi>
Apr 12 09:04:45 user nova-compute[71482]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 12 09:04:45 user nova-compute[71482]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 12 09:04:45 user nova-compute[71482]:     </secmodel>
Apr 12 09:04:45 user nova-compute[71482]:   </host>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='alpha'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>clipper</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='armv6l'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>spitz</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>nuri</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>kzm</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sx1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>z2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>tosa</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>n810</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>n800</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>terrier</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>midway</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>microbit</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>verdex</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>highbank</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>akita</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>connex</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>collie</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='armv7l'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>spitz</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>nuri</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>kzm</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sx1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>z2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>tosa</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>n810</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>n800</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>terrier</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>midway</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>microbit</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>verdex</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>highbank</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>akita</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>connex</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>collie</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='aarch64'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>integratorcp</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>borzoi</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>spitz</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>nuri</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>musca-b1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>versatileab</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>kzm</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>musca-a</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>smdkc210</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sx1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>z2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>tosa</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>sabrelite</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>realview-eb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>n810</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>n800</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>versatilepb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>terrier</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mainstone</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>midway</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>musicpal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>microbit</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>cubieboard</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>verdex</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>netduino2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>raspi3b</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>raspi2b</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>cheetah</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>highbank</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>akita</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>connex</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>collie</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>raspi0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <acpi default='on' toggle='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='cris'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='i686'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>isapc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>microvm</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='kvm'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <pae/>
Apr 12 09:04:45 user nova-compute[71482]:       <nonpae/>
Apr 12 09:04:45 user nova-compute[71482]:       <acpi default='on' toggle='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:       <apic default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='m68k'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>an5206</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>q800</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>next-cube</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='microblaze'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='microblazeel'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='mips'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='16'>malta</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='mipsel'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='16'>malta</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='mips64'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='16'>malta</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>pica61</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>magnum</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='mips64el'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='16'>malta</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mipssim</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>pica61</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>magnum</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='16'>boston</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='ppc'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mac99</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>40p</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>taihu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='ppc64'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>taihu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>40p</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mac99</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='ppc64le'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2048'>powernv9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>taihu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2048'>powernv10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>ppce500</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>40p</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>pegasos2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>bamboo</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>g3beige</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>mac99</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sam460ex</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>ref405ep</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2048'>powernv8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='riscv32'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='8'>spike</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>opentitan</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='8'>virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='riscv64'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='8'>spike</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='5'>sifive_u</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>shakti_c</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sifive_e</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='8'>virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='s390x'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='sh4'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>shix</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>r2d</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='sh4eb'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>shix</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>r2d</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='sparc'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>SS-5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>SS-20</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>LX</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>SS-4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>SS-10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>Voyager</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='sparc64'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sun4u</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>niagara</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>sun4v</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='x86_64'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>64</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>x-remote</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='1'>isapc</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>microvm</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='kvm'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <acpi default='on' toggle='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:       <apic default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='xtensa'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>sim</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>kc705</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>ml605</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>lx200</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>lx60</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]:   <guest>
Apr 12 09:04:45 user nova-compute[71482]:     <os_type>hvm</os_type>
Apr 12 09:04:45 user nova-compute[71482]:     <arch name='xtensaeb'>
Apr 12 09:04:45 user nova-compute[71482]:       <wordsize>32</wordsize>
Apr 12 09:04:45 user nova-compute[71482]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='4'>sim</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>kc705</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>ml605</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>virt</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>lx200</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>lx60</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 12 09:04:45 user nova-compute[71482]:       <domain type='qemu'/>
Apr 12 09:04:45 user nova-compute[71482]:     </arch>
Apr 12 09:04:45 user nova-compute[71482]:     <features>
Apr 12 09:04:45 user nova-compute[71482]:       <cpuselection/>
Apr 12 09:04:45 user nova-compute[71482]:       <deviceboot/>
Apr 12 09:04:45 user nova-compute[71482]:       <disksnapshot default='on' toggle='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     </features>
Apr 12 09:04:45 user nova-compute[71482]:   </guest>
Apr 12 09:04:45 user nova-compute[71482]: </capabilities>
Apr 12 09:04:45 user nova-compute[71482]: 
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 12 09:04:45 user nova-compute[71482]: <domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 09:04:45 user nova-compute[71482]:   <domain>kvm</domain>
Apr 12 09:04:45 user nova-compute[71482]:   <machine>pc-i440fx-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:   <arch>i686</arch>
Apr 12 09:04:45 user nova-compute[71482]:   <vcpu max='255'/>
Apr 12 09:04:45 user nova-compute[71482]:   <iothreads supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:   <os supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='firmware'/>
Apr 12 09:04:45 user nova-compute[71482]:     <loader supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>rom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pflash</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='readonly'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='secure'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </loader>
Apr 12 09:04:45 user nova-compute[71482]:   </os>
Apr 12 09:04:45 user nova-compute[71482]:   <cpu>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-passthrough' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='hostPassthroughMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='maximum' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='maximumMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-model' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <vendor>Intel</vendor>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ss'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='vmx'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pcid'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='hypervisor'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arat'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='umip'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='md-clear'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibpb'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibrs'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='erms'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='lm'/>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='custom' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>qemu64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>qemu32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>phenom</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>n270</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>kvm64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>coreduo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>core2duo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>athlon</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Westmere</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Snowridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Penryn</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G5</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G4</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G1</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Nehalem</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Rome</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Milan</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Dhyana</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cooperlake</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Conroe</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>486</model>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:   </cpu>
Apr 12 09:04:45 user nova-compute[71482]:   <memoryBacking supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='sourceType'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>file</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>anonymous</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>memfd</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:   </memoryBacking>
Apr 12 09:04:45 user nova-compute[71482]:   <devices>
Apr 12 09:04:45 user nova-compute[71482]:     <disk supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='diskDevice'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>disk</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cdrom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>floppy</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>lun</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='bus'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ide</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>fdc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sata</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </disk>
Apr 12 09:04:45 user nova-compute[71482]:     <graphics supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sdl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vnc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>spice</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egl-headless</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </graphics>
Apr 12 09:04:45 user nova-compute[71482]:     <video supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='modelType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cirrus</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vmvga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>qxl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>none</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>bochs</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ramfb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </video>
Apr 12 09:04:45 user nova-compute[71482]:     <hostdev supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='mode'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>subsystem</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='startupPolicy'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>default</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>mandatory</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>requisite</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>optional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='subsysType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pci</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='capsType'/>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='pciBackend'/>
Apr 12 09:04:45 user nova-compute[71482]:     </hostdev>
Apr 12 09:04:45 user nova-compute[71482]:     <rng supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>random</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egd</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>builtin</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </rng>
Apr 12 09:04:45 user nova-compute[71482]:     <filesystem supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='driverType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>path</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>handle</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtiofs</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </filesystem>
Apr 12 09:04:45 user nova-compute[71482]:     <tpm supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-tis</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-crb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>passthrough</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>emulator</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </tpm>
Apr 12 09:04:45 user nova-compute[71482]:   </devices>
Apr 12 09:04:45 user nova-compute[71482]:   <features>
Apr 12 09:04:45 user nova-compute[71482]:     <gic supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     <vmcoreinfo supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <genid supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backingStoreInput supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backup supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <sev supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:   </features>
Apr 12 09:04:45 user nova-compute[71482]: </domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:  {{(pid=71482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 12 09:04:45 user nova-compute[71482]: <domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 09:04:45 user nova-compute[71482]:   <domain>kvm</domain>
Apr 12 09:04:45 user nova-compute[71482]:   <machine>pc-i440fx-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:   <arch>i686</arch>
Apr 12 09:04:45 user nova-compute[71482]:   <vcpu max='255'/>
Apr 12 09:04:45 user nova-compute[71482]:   <iothreads supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:   <os supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='firmware'/>
Apr 12 09:04:45 user nova-compute[71482]:     <loader supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>rom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pflash</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='readonly'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='secure'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </loader>
Apr 12 09:04:45 user nova-compute[71482]:   </os>
Apr 12 09:04:45 user nova-compute[71482]:   <cpu>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-passthrough' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='hostPassthroughMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='maximum' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='maximumMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-model' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <vendor>Intel</vendor>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ss'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='vmx'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pcid'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='hypervisor'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arat'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='umip'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='md-clear'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibpb'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibrs'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='erms'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='lm'/>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='custom' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>qemu64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>qemu32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>phenom</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>n270</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>kvm64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>coreduo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>core2duo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>athlon</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Westmere</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Snowridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Penryn</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G5</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G4</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G1</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Nehalem</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Rome</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Milan</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Dhyana</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cooperlake</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Conroe</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>486</model>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:   </cpu>
Apr 12 09:04:45 user nova-compute[71482]:   <memoryBacking supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='sourceType'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>file</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>anonymous</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>memfd</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:   </memoryBacking>
Apr 12 09:04:45 user nova-compute[71482]:   <devices>
Apr 12 09:04:45 user nova-compute[71482]:     <disk supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='diskDevice'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>disk</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cdrom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>floppy</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>lun</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='bus'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ide</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>fdc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sata</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </disk>
Apr 12 09:04:45 user nova-compute[71482]:     <graphics supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sdl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vnc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>spice</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egl-headless</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </graphics>
Apr 12 09:04:45 user nova-compute[71482]:     <video supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='modelType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cirrus</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vmvga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>qxl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>none</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>bochs</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ramfb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </video>
Apr 12 09:04:45 user nova-compute[71482]:     <hostdev supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='mode'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>subsystem</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='startupPolicy'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>default</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>mandatory</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>requisite</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>optional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='subsysType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pci</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='capsType'/>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='pciBackend'/>
Apr 12 09:04:45 user nova-compute[71482]:     </hostdev>
Apr 12 09:04:45 user nova-compute[71482]:     <rng supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>random</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egd</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>builtin</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </rng>
Apr 12 09:04:45 user nova-compute[71482]:     <filesystem supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='driverType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>path</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>handle</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtiofs</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </filesystem>
Apr 12 09:04:45 user nova-compute[71482]:     <tpm supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-tis</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-crb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>passthrough</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>emulator</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </tpm>
Apr 12 09:04:45 user nova-compute[71482]:   </devices>
Apr 12 09:04:45 user nova-compute[71482]:   <features>
Apr 12 09:04:45 user nova-compute[71482]:     <gic supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     <vmcoreinfo supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <genid supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backingStoreInput supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backup supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <sev supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:   </features>
Apr 12 09:04:45 user nova-compute[71482]: </domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:  {{(pid=71482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 12 09:04:45 user nova-compute[71482]: <domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 09:04:45 user nova-compute[71482]:   <domain>kvm</domain>
Apr 12 09:04:45 user nova-compute[71482]:   <machine>pc-q35-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:   <arch>i686</arch>
Apr 12 09:04:45 user nova-compute[71482]:   <vcpu max='288'/>
Apr 12 09:04:45 user nova-compute[71482]:   <iothreads supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:   <os supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='firmware'/>
Apr 12 09:04:45 user nova-compute[71482]:     <loader supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>rom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pflash</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='readonly'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='secure'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </loader>
Apr 12 09:04:45 user nova-compute[71482]:   </os>
Apr 12 09:04:45 user nova-compute[71482]:   <cpu>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-passthrough' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='hostPassthroughMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='maximum' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='maximumMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-model' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <vendor>Intel</vendor>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ss'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='vmx'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pcid'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='hypervisor'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arat'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='umip'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='md-clear'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibpb'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibrs'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='erms'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='lm'/>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='custom' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>qemu64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>qemu32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>phenom</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>n270</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>kvm64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>coreduo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>core2duo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>athlon</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Westmere</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Snowridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Penryn</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G5</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G4</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G1</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Nehalem</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Rome</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Milan</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Dhyana</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cooperlake</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Conroe</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>486</model>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:   </cpu>
Apr 12 09:04:45 user nova-compute[71482]:   <memoryBacking supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='sourceType'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>file</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>anonymous</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>memfd</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:   </memoryBacking>
Apr 12 09:04:45 user nova-compute[71482]:   <devices>
Apr 12 09:04:45 user nova-compute[71482]:     <disk supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='diskDevice'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>disk</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cdrom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>floppy</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>lun</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='bus'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>fdc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sata</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </disk>
Apr 12 09:04:45 user nova-compute[71482]:     <graphics supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sdl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vnc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>spice</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egl-headless</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </graphics>
Apr 12 09:04:45 user nova-compute[71482]:     <video supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='modelType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cirrus</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vmvga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>qxl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>none</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>bochs</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ramfb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </video>
Apr 12 09:04:45 user nova-compute[71482]:     <hostdev supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='mode'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>subsystem</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='startupPolicy'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>default</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>mandatory</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>requisite</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>optional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='subsysType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pci</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='capsType'/>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='pciBackend'/>
Apr 12 09:04:45 user nova-compute[71482]:     </hostdev>
Apr 12 09:04:45 user nova-compute[71482]:     <rng supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>random</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egd</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>builtin</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </rng>
Apr 12 09:04:45 user nova-compute[71482]:     <filesystem supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='driverType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>path</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>handle</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtiofs</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </filesystem>
Apr 12 09:04:45 user nova-compute[71482]:     <tpm supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-tis</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-crb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>passthrough</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>emulator</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </tpm>
Apr 12 09:04:45 user nova-compute[71482]:   </devices>
Apr 12 09:04:45 user nova-compute[71482]:   <features>
Apr 12 09:04:45 user nova-compute[71482]:     <gic supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     <vmcoreinfo supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <genid supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backingStoreInput supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backup supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <sev supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:   </features>
Apr 12 09:04:45 user nova-compute[71482]: </domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:  {{(pid=71482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 12 09:04:45 user nova-compute[71482]: <domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:   <path>/usr/bin/qemu-system-i386</path>
Apr 12 09:04:45 user nova-compute[71482]:   <domain>kvm</domain>
Apr 12 09:04:45 user nova-compute[71482]:   <machine>pc-q35-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:   <arch>i686</arch>
Apr 12 09:04:45 user nova-compute[71482]:   <vcpu max='288'/>
Apr 12 09:04:45 user nova-compute[71482]:   <iothreads supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:   <os supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='firmware'/>
Apr 12 09:04:45 user nova-compute[71482]:     <loader supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>rom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pflash</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='readonly'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='secure'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </loader>
Apr 12 09:04:45 user nova-compute[71482]:   </os>
Apr 12 09:04:45 user nova-compute[71482]:   <cpu>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-passthrough' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='hostPassthroughMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='maximum' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='maximumMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-model' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <vendor>Intel</vendor>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ss'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='vmx'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pcid'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='hypervisor'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arat'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='umip'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='md-clear'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibpb'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibrs'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='erms'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='lm'/>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='custom' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>qemu64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>qemu32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>phenom</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>n270</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>kvm64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>coreduo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>core2duo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>athlon</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Westmere-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Westmere</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Snowridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Penryn</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G5</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G4</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G1</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Nehalem-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Nehalem</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Rome</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Milan</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Dhyana</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cooperlake</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Conroe</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>486</model>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:   </cpu>
Apr 12 09:04:45 user nova-compute[71482]:   <memoryBacking supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='sourceType'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>file</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>anonymous</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>memfd</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:   </memoryBacking>
Apr 12 09:04:45 user nova-compute[71482]:   <devices>
Apr 12 09:04:45 user nova-compute[71482]:     <disk supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='diskDevice'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>disk</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cdrom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>floppy</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>lun</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='bus'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>fdc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sata</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </disk>
Apr 12 09:04:45 user nova-compute[71482]:     <graphics supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sdl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vnc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>spice</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egl-headless</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </graphics>
Apr 12 09:04:45 user nova-compute[71482]:     <video supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='modelType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cirrus</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vmvga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>qxl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>none</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>bochs</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ramfb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </video>
Apr 12 09:04:45 user nova-compute[71482]:     <hostdev supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='mode'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>subsystem</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='startupPolicy'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>default</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>mandatory</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>requisite</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>optional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='subsysType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pci</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='capsType'/>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='pciBackend'/>
Apr 12 09:04:45 user nova-compute[71482]:     </hostdev>
Apr 12 09:04:45 user nova-compute[71482]:     <rng supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>random</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egd</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>builtin</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </rng>
Apr 12 09:04:45 user nova-compute[71482]:     <filesystem supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='driverType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>path</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>handle</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtiofs</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </filesystem>
Apr 12 09:04:45 user nova-compute[71482]:     <tpm supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-tis</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-crb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>passthrough</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>emulator</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </tpm>
Apr 12 09:04:45 user nova-compute[71482]:   </devices>
Apr 12 09:04:45 user nova-compute[71482]:   <features>
Apr 12 09:04:45 user nova-compute[71482]:     <gic supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     <vmcoreinfo supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <genid supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backingStoreInput supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backup supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <sev supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:   </features>
Apr 12 09:04:45 user nova-compute[71482]: </domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:  {{(pid=71482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 12 09:04:45 user nova-compute[71482]: <domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 09:04:45 user nova-compute[71482]:   <domain>kvm</domain>
Apr 12 09:04:45 user nova-compute[71482]:   <machine>pc-i440fx-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:   <arch>x86_64</arch>
Apr 12 09:04:45 user nova-compute[71482]:   <vcpu max='255'/>
Apr 12 09:04:45 user nova-compute[71482]:   <iothreads supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:   <os supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='firmware'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>efi</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:     <loader supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>rom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pflash</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='readonly'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='secure'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </loader>
Apr 12 09:04:45 user nova-compute[71482]:   </os>
Apr 12 09:04:45 user nova-compute[71482]:   <cpu>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-passthrough' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='hostPassthroughMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='maximum' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='maximumMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-model' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <vendor>Intel</vendor>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ss'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='vmx'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pcid'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='hypervisor'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arat'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='umip'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='md-clear'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='invtsc'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibpb'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibrs'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='rsba'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='erms'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='custom' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>qemu64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>qemu32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>phenom</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>n270</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>coreduo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>core2duo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>athlon</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Westmere</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Snowridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Penryn</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G5</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G4</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Opteron_G1</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Nehalem</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Rome</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Milan</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Dhyana</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cooperlake</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Conroe</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>486</model>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:   </cpu>
Apr 12 09:04:45 user nova-compute[71482]:   <memoryBacking supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='sourceType'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>file</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>anonymous</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>memfd</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:   </memoryBacking>
Apr 12 09:04:45 user nova-compute[71482]:   <devices>
Apr 12 09:04:45 user nova-compute[71482]:     <disk supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='diskDevice'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>disk</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cdrom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>floppy</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>lun</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='bus'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ide</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>fdc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sata</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </disk>
Apr 12 09:04:45 user nova-compute[71482]:     <graphics supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sdl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vnc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>spice</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egl-headless</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </graphics>
Apr 12 09:04:45 user nova-compute[71482]:     <video supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='modelType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cirrus</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vmvga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>qxl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>none</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>bochs</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ramfb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </video>
Apr 12 09:04:45 user nova-compute[71482]:     <hostdev supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='mode'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>subsystem</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='startupPolicy'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>default</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>mandatory</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>requisite</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>optional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='subsysType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pci</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='capsType'/>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='pciBackend'/>
Apr 12 09:04:45 user nova-compute[71482]:     </hostdev>
Apr 12 09:04:45 user nova-compute[71482]:     <rng supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>random</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egd</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>builtin</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </rng>
Apr 12 09:04:45 user nova-compute[71482]:     <filesystem supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='driverType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>path</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>handle</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtiofs</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </filesystem>
Apr 12 09:04:45 user nova-compute[71482]:     <tpm supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-tis</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-crb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>passthrough</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>emulator</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </tpm>
Apr 12 09:04:45 user nova-compute[71482]:   </devices>
Apr 12 09:04:45 user nova-compute[71482]:   <features>
Apr 12 09:04:45 user nova-compute[71482]:     <gic supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     <vmcoreinfo supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <genid supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backingStoreInput supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backup supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <sev supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:   </features>
Apr 12 09:04:45 user nova-compute[71482]: </domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:  {{(pid=71482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 12 09:04:45 user nova-compute[71482]: <domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 09:04:45 user nova-compute[71482]:   <domain>kvm</domain>
Apr 12 09:04:45 user nova-compute[71482]:   <machine>pc-i440fx-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:   <arch>x86_64</arch>
Apr 12 09:04:45 user nova-compute[71482]:   <vcpu max='255'/>
Apr 12 09:04:45 user nova-compute[71482]:   <iothreads supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:   <os supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='firmware'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>efi</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:     <loader supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>rom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pflash</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='readonly'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='secure'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </loader>
Apr 12 09:04:45 user nova-compute[71482]:   </os>
Apr 12 09:04:45 user nova-compute[71482]:   <cpu>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-passthrough' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='hostPassthroughMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='maximum' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='maximumMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-model' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <vendor>Intel</vendor>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ss'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='vmx'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pcid'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='hypervisor'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arat'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='umip'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='md-clear'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='invtsc'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibpb'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibrs'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='rsba'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='erms'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='custom' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>qemu64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>qemu32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>phenom</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>n270</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>coreduo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>core2duo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>athlon</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Westmere</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Snowridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Penryn</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G5</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G4</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Opteron_G1</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Nehalem</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Rome</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Milan</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Dhyana</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cooperlake</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Conroe</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>486</model>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:   </cpu>
Apr 12 09:04:45 user nova-compute[71482]:   <memoryBacking supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='sourceType'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>file</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>anonymous</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>memfd</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:   </memoryBacking>
Apr 12 09:04:45 user nova-compute[71482]:   <devices>
Apr 12 09:04:45 user nova-compute[71482]:     <disk supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='diskDevice'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>disk</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cdrom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>floppy</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>lun</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='bus'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ide</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>fdc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sata</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </disk>
Apr 12 09:04:45 user nova-compute[71482]:     <graphics supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sdl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vnc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>spice</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egl-headless</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </graphics>
Apr 12 09:04:45 user nova-compute[71482]:     <video supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='modelType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cirrus</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vmvga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>qxl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>none</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>bochs</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ramfb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </video>
Apr 12 09:04:45 user nova-compute[71482]:     <hostdev supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='mode'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>subsystem</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='startupPolicy'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>default</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>mandatory</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>requisite</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>optional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='subsysType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pci</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='capsType'/>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='pciBackend'/>
Apr 12 09:04:45 user nova-compute[71482]:     </hostdev>
Apr 12 09:04:45 user nova-compute[71482]:     <rng supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>random</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egd</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>builtin</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </rng>
Apr 12 09:04:45 user nova-compute[71482]:     <filesystem supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='driverType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>path</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>handle</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtiofs</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </filesystem>
Apr 12 09:04:45 user nova-compute[71482]:     <tpm supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-tis</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-crb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>passthrough</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>emulator</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </tpm>
Apr 12 09:04:45 user nova-compute[71482]:   </devices>
Apr 12 09:04:45 user nova-compute[71482]:   <features>
Apr 12 09:04:45 user nova-compute[71482]:     <gic supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     <vmcoreinfo supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <genid supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backingStoreInput supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backup supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <sev supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:   </features>
Apr 12 09:04:45 user nova-compute[71482]: </domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:  {{(pid=71482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 12 09:04:45 user nova-compute[71482]: <domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 09:04:45 user nova-compute[71482]:   <domain>kvm</domain>
Apr 12 09:04:45 user nova-compute[71482]:   <machine>pc-q35-jammy</machine>
Apr 12 09:04:45 user nova-compute[71482]:   <arch>x86_64</arch>
Apr 12 09:04:45 user nova-compute[71482]:   <vcpu max='288'/>
Apr 12 09:04:45 user nova-compute[71482]:   <iothreads supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:   <os supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='firmware'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>efi</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:     <loader supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>rom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pflash</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='readonly'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='secure'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </loader>
Apr 12 09:04:45 user nova-compute[71482]:   </os>
Apr 12 09:04:45 user nova-compute[71482]:   <cpu>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-passthrough' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='hostPassthroughMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='maximum' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='maximumMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-model' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <vendor>Intel</vendor>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ss'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='vmx'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pcid'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='hypervisor'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arat'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='umip'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='md-clear'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='invtsc'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibpb'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibrs'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='rsba'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='erms'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='custom' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>qemu64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>qemu32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>phenom</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>n270</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>coreduo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>core2duo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>athlon</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Westmere</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Snowridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Penryn</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G5</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G4</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Opteron_G1</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Nehalem</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Rome</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Milan</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Dhyana</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cooperlake</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Conroe</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>486</model>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:   </cpu>
Apr 12 09:04:45 user nova-compute[71482]:   <memoryBacking supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='sourceType'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>file</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>anonymous</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>memfd</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:   </memoryBacking>
Apr 12 09:04:45 user nova-compute[71482]:   <devices>
Apr 12 09:04:45 user nova-compute[71482]:     <disk supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='diskDevice'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>disk</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cdrom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>floppy</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>lun</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='bus'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>fdc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sata</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </disk>
Apr 12 09:04:45 user nova-compute[71482]:     <graphics supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sdl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vnc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>spice</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egl-headless</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </graphics>
Apr 12 09:04:45 user nova-compute[71482]:     <video supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='modelType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cirrus</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vmvga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>qxl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>none</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>bochs</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ramfb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </video>
Apr 12 09:04:45 user nova-compute[71482]:     <hostdev supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='mode'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>subsystem</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='startupPolicy'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>default</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>mandatory</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>requisite</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>optional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='subsysType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pci</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='capsType'/>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='pciBackend'/>
Apr 12 09:04:45 user nova-compute[71482]:     </hostdev>
Apr 12 09:04:45 user nova-compute[71482]:     <rng supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>random</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egd</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>builtin</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </rng>
Apr 12 09:04:45 user nova-compute[71482]:     <filesystem supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='driverType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>path</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>handle</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtiofs</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </filesystem>
Apr 12 09:04:45 user nova-compute[71482]:     <tpm supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-tis</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-crb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>passthrough</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>emulator</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </tpm>
Apr 12 09:04:45 user nova-compute[71482]:   </devices>
Apr 12 09:04:45 user nova-compute[71482]:   <features>
Apr 12 09:04:45 user nova-compute[71482]:     <gic supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     <vmcoreinfo supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <genid supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backingStoreInput supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backup supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <sev supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:   </features>
Apr 12 09:04:45 user nova-compute[71482]: </domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:  {{(pid=71482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 12 09:04:45 user nova-compute[71482]: <domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 12 09:04:45 user nova-compute[71482]:   <domain>kvm</domain>
Apr 12 09:04:45 user nova-compute[71482]:   <machine>pc-q35-6.2</machine>
Apr 12 09:04:45 user nova-compute[71482]:   <arch>x86_64</arch>
Apr 12 09:04:45 user nova-compute[71482]:   <vcpu max='288'/>
Apr 12 09:04:45 user nova-compute[71482]:   <iothreads supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:   <os supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='firmware'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>efi</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:     <loader supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>rom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pflash</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='readonly'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='secure'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>yes</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>no</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </loader>
Apr 12 09:04:45 user nova-compute[71482]:   </os>
Apr 12 09:04:45 user nova-compute[71482]:   <cpu>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-passthrough' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='hostPassthroughMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='maximum' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='maximumMigratable'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>on</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>off</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='host-model' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <vendor>Intel</vendor>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ss'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='vmx'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pcid'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='hypervisor'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arat'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='tsc_adjust'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='umip'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='md-clear'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='arch-capabilities'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='invtsc'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibpb'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='ibrs'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-stibp'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='amd-ssbd'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='rsba'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='require' name='pschange-mc-no'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='erms'/>
Apr 12 09:04:45 user nova-compute[71482]:       <feature policy='disable' name='xsaveopt'/>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:     <mode name='custom' supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>qemu64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>qemu32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>phenom</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>pentium</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>n270</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm64</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>kvm32</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>coreduo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>core2duo</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>athlon</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Westmere-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Westmere</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Snowridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Skylake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>SandyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Penryn</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G5</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G4</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G3</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Opteron_G2</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Opteron_G1</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Nehalem</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>IvyBridge</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Icelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Haswell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Rome</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-Milan</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC-IBPB</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>EPYC</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Dhyana</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cooperlake</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>Conroe</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Cascadelake-Server</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-noTSX</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell-IBRS</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='no'>Broadwell</model>
Apr 12 09:04:45 user nova-compute[71482]:       <model usable='yes'>486</model>
Apr 12 09:04:45 user nova-compute[71482]:     </mode>
Apr 12 09:04:45 user nova-compute[71482]:   </cpu>
Apr 12 09:04:45 user nova-compute[71482]:   <memoryBacking supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:     <enum name='sourceType'>
Apr 12 09:04:45 user nova-compute[71482]:       <value>file</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>anonymous</value>
Apr 12 09:04:45 user nova-compute[71482]:       <value>memfd</value>
Apr 12 09:04:45 user nova-compute[71482]:     </enum>
Apr 12 09:04:45 user nova-compute[71482]:   </memoryBacking>
Apr 12 09:04:45 user nova-compute[71482]:   <devices>
Apr 12 09:04:45 user nova-compute[71482]:     <disk supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='diskDevice'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>disk</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cdrom</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>floppy</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>lun</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='bus'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>fdc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sata</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </disk>
Apr 12 09:04:45 user nova-compute[71482]:     <graphics supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='type'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>sdl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vnc</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>spice</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egl-headless</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </graphics>
Apr 12 09:04:45 user nova-compute[71482]:     <video supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='modelType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>cirrus</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>vmvga</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>qxl</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>none</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>bochs</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>ramfb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </video>
Apr 12 09:04:45 user nova-compute[71482]:     <hostdev supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='mode'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>subsystem</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='startupPolicy'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>default</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>mandatory</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>requisite</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>optional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='subsysType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>usb</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>pci</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>scsi</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='capsType'/>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='pciBackend'/>
Apr 12 09:04:45 user nova-compute[71482]:     </hostdev>
Apr 12 09:04:45 user nova-compute[71482]:     <rng supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtio-non-transitional</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>random</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>egd</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>builtin</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </rng>
Apr 12 09:04:45 user nova-compute[71482]:     <filesystem supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='driverType'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>path</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>handle</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>virtiofs</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </filesystem>
Apr 12 09:04:45 user nova-compute[71482]:     <tpm supported='yes'>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='model'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-tis</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>tpm-crb</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:       <enum name='backendModel'>
Apr 12 09:04:45 user nova-compute[71482]:         <value>passthrough</value>
Apr 12 09:04:45 user nova-compute[71482]:         <value>emulator</value>
Apr 12 09:04:45 user nova-compute[71482]:       </enum>
Apr 12 09:04:45 user nova-compute[71482]:     </tpm>
Apr 12 09:04:45 user nova-compute[71482]:   </devices>
Apr 12 09:04:45 user nova-compute[71482]:   <features>
Apr 12 09:04:45 user nova-compute[71482]:     <gic supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:     <vmcoreinfo supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <genid supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backingStoreInput supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <backup supported='yes'/>
Apr 12 09:04:45 user nova-compute[71482]:     <sev supported='no'/>
Apr 12 09:04:45 user nova-compute[71482]:   </features>
Apr 12 09:04:45 user nova-compute[71482]: </domainCapabilities>
Apr 12 09:04:45 user nova-compute[71482]:  {{(pid=71482) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71482) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71482) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Checking secure boot support for host arch (x86_64) {{(pid=71482) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Checking secure boot support for host arch (x86_64) {{(pid=71482) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Checking secure boot support for host arch (x86_64) {{(pid=71482) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Checking secure boot support for host arch (x86_64) {{(pid=71482) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Checking secure boot support for host arch (x86_64) {{(pid=71482) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 12 09:04:45 user nova-compute[71482]: INFO nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Secure Boot support detected
Apr 12 09:04:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] cpu compare xml: <cpu match="exact">
Apr 12 09:04:45 user nova-compute[71482]:   <model>Nehalem</model>
Apr 12 09:04:45 user nova-compute[71482]: </cpu>
Apr 12 09:04:45 user nova-compute[71482]:  {{(pid=71482) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 12 09:04:45 user nova-compute[71482]: INFO nova.virt.node [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Generated node identity bde6c1bb-b134-4972-af52-5525f319b91c
Apr 12 09:04:45 user nova-compute[71482]: INFO nova.virt.node [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Wrote node identity bde6c1bb-b134-4972-af52-5525f319b91c to /opt/stack/data/nova/compute_id
Apr 12 09:04:45 user nova-compute[71482]: WARNING nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Compute nodes ['bde6c1bb-b134-4972-af52-5525f319b91c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 12 09:04:46 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 12 09:04:46 user nova-compute[71482]: WARNING nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 12 09:04:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:04:46 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:04:46 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Hypervisor/Node resource view: name=user free_ram=10845MB free_disk=27.1514892578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:04:46 user nova-compute[71482]: WARNING nova.compute.resource_tracker [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] No compute node record for user:bde6c1bb-b134-4972-af52-5525f319b91c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host bde6c1bb-b134-4972-af52-5525f319b91c could not be found.
Apr 12 09:04:46 user nova-compute[71482]: INFO nova.compute.resource_tracker [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Compute node record created for user:user with uuid: bde6c1bb-b134-4972-af52-5525f319b91c
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:04:46 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [req-ff80bf1d-d947-4b33-986a-8664c841e687] Created resource provider record via placement API for resource provider with UUID bde6c1bb-b134-4972-af52-5525f319b91c and name user.
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71482) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 12 09:04:46 user nova-compute[71482]: INFO nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] kernel doesn't support AMD SEV
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Libvirt baseline CPU <cpu>
Apr 12 09:04:46 user nova-compute[71482]:   <arch>x86_64</arch>
Apr 12 09:04:46 user nova-compute[71482]:   <model>Nehalem</model>
Apr 12 09:04:46 user nova-compute[71482]:   <vendor>Intel</vendor>
Apr 12 09:04:46 user nova-compute[71482]:   <topology sockets="6" cores="1" threads="1"/>
Apr 12 09:04:46 user nova-compute[71482]: </cpu>
Apr 12 09:04:46 user nova-compute[71482]:  {{(pid=71482) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Updated inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Updating resource provider bde6c1bb-b134-4972-af52-5525f319b91c generation from 0 to 1 during operation: update_inventory {{(pid=71482) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 09:04:46 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:04:47 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Updating resource provider bde6c1bb-b134-4972-af52-5525f319b91c generation from 1 to 2 during operation: update_traits {{(pid=71482) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 12 09:04:47 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:04:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:04:47 user nova-compute[71482]: DEBUG nova.service [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Creating RPC server for service compute {{(pid=71482) start /opt/stack/nova/nova/service.py:182}}
Apr 12 09:04:47 user nova-compute[71482]: DEBUG nova.service [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Join ServiceGroup membership for this service compute {{(pid=71482) start /opt/stack/nova/nova/service.py:199}}
Apr 12 09:04:47 user nova-compute[71482]: DEBUG nova.servicegroup.drivers.db [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71482) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:05:46 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:05:46 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=10270MB free_disk=27.065052032470703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:05:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:06:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:06:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:06:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:06:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=10182MB free_disk=27.11025619506836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:06:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:06:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:06:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:06:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:06:39 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:06:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:06:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:06:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:06:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:06:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:07:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:07:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:07:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:07:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=10220MB free_disk=26.887374877929688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:07:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:07:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:07:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:07:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:07:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:07:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "a569c652-6b15-4244-b011-1d09fbdd4281" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "a569c652-6b15-4244-b011-1d09fbdd4281" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:08:39 user nova-compute[71482]: INFO nova.compute.claims [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Claim successful on node user
Apr 12 09:08:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG nova.network.neutron [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:08:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:08:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:08:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Creating image(s)
Apr 12 09:08:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "/opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "/opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "/opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.policy [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609.part --force-share --output=json" returned: 0 in 0.453s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.virt.images [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 4a835d20-3733-4a8b-bebd-54dfa6135dd6 was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609.part /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:41 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:08:41 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=9409MB free_disk=26.87872314453125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609.part /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609.converted" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.228s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:41 user nova-compute[71482]: INFO oslo.privsep.daemon [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpopgn94d9/privsep.sock']
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:08:41 user sudo[80195]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpopgn94d9/privsep.sock
Apr 12 09:08:41 user sudo[80195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:08:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:08:43 user sudo[80195]: pam_unix(sudo:session): session closed for user root
Apr 12 09:08:43 user nova-compute[71482]: INFO oslo.privsep.daemon [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Spawned new privsep daemon via rootwrap
Apr 12 09:08:43 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 09:08:43 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 09:08:43 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 12 09:08:43 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80203
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk 1073741824" returned: 0 in 0.043s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.126s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Cannot resize image /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG nova.objects.instance [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'migration_context' on Instance uuid a569c652-6b15-4244-b011-1d09fbdd4281 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Ensure instance console log exists: /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:45 user nova-compute[71482]: DEBUG nova.network.neutron [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Successfully created port: b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:08:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Successfully updated port: b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:08:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:08:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquired lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:08:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:08:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:08:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received event network-changed-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:08:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Refreshing instance network info cache due to event network-changed-b2a3049a-cc8d-4804-854e-2451b7f886fd. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:08:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Acquiring lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.network.neutron [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updating instance_info_cache with network_info: [{"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Releasing lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Instance network_info: |[{"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Acquired lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.network.neutron [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Refreshing network info cache for port b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Start _get_guest_xml network_info=[{"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:08:51 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:08:51 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499919168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499919168',id=1,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-mzwztiq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:08:41Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=a569c652-6b15-4244-b011-1d09fbdd4281,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:5c:42,bridge_name='br-int',has_traffic_filtering=True,id=b2a3049a-cc8d-4804-854e-2451b7f886fd,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a3049a-cc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.objects.instance [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'pci_devices' on Instance uuid a569c652-6b15-4244-b011-1d09fbdd4281 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:08:51 user nova-compute[71482]:   <uuid>a569c652-6b15-4244-b011-1d09fbdd4281</uuid>
Apr 12 09:08:51 user nova-compute[71482]:   <name>instance-00000001</name>
Apr 12 09:08:51 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:08:51 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:08:51 user nova-compute[71482]:   <metadata>
Apr 12 09:08:51 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:08:51 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:08:51 user nova-compute[71482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1499919168</nova:name>
Apr 12 09:08:51 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:08:51</nova:creationTime>
Apr 12 09:08:51 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:08:51 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:08:51 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:08:51 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:08:51 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:08:51 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:08:51 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:08:51 user nova-compute[71482]:       <nova:owner>
Apr 12 09:08:51 user nova-compute[71482]:         <nova:user uuid="cc51704e74b045ad9733a43aec982390">tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member</nova:user>
Apr 12 09:08:51 user nova-compute[71482]:         <nova:project uuid="a6ce4a0f4dad40c18fd8a83470c15f05">tempest-ServerBootFromVolumeStableRescueTest-1244466684</nova:project>
Apr 12 09:08:51 user nova-compute[71482]:       </nova:owner>
Apr 12 09:08:51 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:08:51 user nova-compute[71482]:       <nova:ports>
Apr 12 09:08:51 user nova-compute[71482]:         <nova:port uuid="b2a3049a-cc8d-4804-854e-2451b7f886fd">
Apr 12 09:08:51 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 09:08:51 user nova-compute[71482]:         </nova:port>
Apr 12 09:08:51 user nova-compute[71482]:       </nova:ports>
Apr 12 09:08:51 user nova-compute[71482]:     </nova:instance>
Apr 12 09:08:51 user nova-compute[71482]:   </metadata>
Apr 12 09:08:51 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:08:51 user nova-compute[71482]:     <system>
Apr 12 09:08:51 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:08:51 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:08:51 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:08:51 user nova-compute[71482]:       <entry name="serial">a569c652-6b15-4244-b011-1d09fbdd4281</entry>
Apr 12 09:08:51 user nova-compute[71482]:       <entry name="uuid">a569c652-6b15-4244-b011-1d09fbdd4281</entry>
Apr 12 09:08:51 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:08:51 user nova-compute[71482]:     </system>
Apr 12 09:08:51 user nova-compute[71482]:   </sysinfo>
Apr 12 09:08:51 user nova-compute[71482]:   <os>
Apr 12 09:08:51 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:08:51 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:08:51 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:08:51 user nova-compute[71482]:   </os>
Apr 12 09:08:51 user nova-compute[71482]:   <features>
Apr 12 09:08:51 user nova-compute[71482]:     <acpi/>
Apr 12 09:08:51 user nova-compute[71482]:     <apic/>
Apr 12 09:08:51 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:08:51 user nova-compute[71482]:   </features>
Apr 12 09:08:51 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:08:51 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:08:51 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:08:51 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:08:51 user nova-compute[71482]:   </clock>
Apr 12 09:08:51 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:08:51 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:08:51 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:08:51 user nova-compute[71482]:   </cpu>
Apr 12 09:08:51 user nova-compute[71482]:   <devices>
Apr 12 09:08:51 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:08:51 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:08:51 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk"/>
Apr 12 09:08:51 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:08:51 user nova-compute[71482]:     </disk>
Apr 12 09:08:51 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:08:51 user nova-compute[71482]:       <mac address="fa:16:3e:af:5c:42"/>
Apr 12 09:08:51 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:08:51 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:08:51 user nova-compute[71482]:       <target dev="tapb2a3049a-cc"/>
Apr 12 09:08:51 user nova-compute[71482]:     </interface>
Apr 12 09:08:51 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:08:51 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/console.log" append="off"/>
Apr 12 09:08:51 user nova-compute[71482]:     </serial>
Apr 12 09:08:51 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:08:51 user nova-compute[71482]:     <video>
Apr 12 09:08:51 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:08:51 user nova-compute[71482]:     </video>
Apr 12 09:08:51 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:08:51 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:08:51 user nova-compute[71482]:     </rng>
Apr 12 09:08:51 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:08:51 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:08:51 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:08:51 user nova-compute[71482]:     </memballoon>
Apr 12 09:08:51 user nova-compute[71482]:   </devices>
Apr 12 09:08:51 user nova-compute[71482]: </domain>
Apr 12 09:08:51 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499919168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499919168',id=1,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-mzwztiq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:08:41Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=a569c652-6b15-4244-b011-1d09fbdd4281,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:5c:42,bridge_name='br-int',has_traffic_filtering=True,id=b2a3049a-cc8d-4804-854e-2451b7f886fd,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a3049a-cc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:08:51 user nova-compute[71482]: DEBUG os_vif [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:5c:42,bridge_name='br-int',has_traffic_filtering=True,id=b2a3049a-cc8d-4804-854e-2451b7f886fd,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a3049a-cc') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Created schema index Interface.name {{(pid=71482) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Created schema index Port.name {{(pid=71482) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Created schema index Bridge.name {{(pid=71482) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [POLLOUT] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:08:52 user nova-compute[71482]: INFO oslo.privsep.daemon [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpl4khpop7/privsep.sock']
Apr 12 09:08:52 user sudo[80222]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpl4khpop7/privsep.sock
Apr 12 09:08:52 user sudo[80222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 09:08:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG nova.network.neutron [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updated VIF entry in instance network info cache for port b2a3049a-cc8d-4804-854e-2451b7f886fd. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG nova.network.neutron [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updating instance_info_cache with network_info: [{"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:08:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5b35e5ee-6203-4873-bfc2-3c86e4d5efe3 req-00052f0d-4e4d-4a6e-99f4-6c684d52b94a service nova] Releasing lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:08:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:53 user sudo[80222]: pam_unix(sudo:session): session closed for user root
Apr 12 09:08:53 user nova-compute[71482]: INFO oslo.privsep.daemon [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Spawned new privsep daemon via rootwrap
Apr 12 09:08:53 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 09:08:53 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 09:08:53 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 12 09:08:53 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80227
Apr 12 09:08:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2a3049a-cc, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:08:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2a3049a-cc, col_values=(('external_ids', {'iface-id': 'b2a3049a-cc8d-4804-854e-2451b7f886fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:5c:42', 'vm-uuid': 'a569c652-6b15-4244-b011-1d09fbdd4281'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:08:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:08:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:54 user nova-compute[71482]: INFO os_vif [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:5c:42,bridge_name='br-int',has_traffic_filtering=True,id=b2a3049a-cc8d-4804-854e-2451b7f886fd,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a3049a-cc')
Apr 12 09:08:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:08:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No VIF found with MAC fa:16:3e:af:5c:42, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:08:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:08:55 user nova-compute[71482]: INFO nova.compute.claims [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Claim successful on node user
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:08:55 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:08:55 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Creating image(s)
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "/opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "/opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG nova.policy [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69a651c616da4b3b98a71a43b07512d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c93767066d345a081bd30ca6d52ccd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk 1073741824" returned: 0 in 0.069s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Cannot resize image /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lazy-loading 'migration_context' on Instance uuid 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Ensure instance console log exists: /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:56 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Successfully created port: 04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290537.3036964, a569c652-6b15-4244-b011-1d09fbdd4281 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] VM Resumed (Lifecycle Event)
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Instance spawned successfully.
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Successfully updated port: 04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.compute.claims [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Claim successful on node user
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "refresh_cache-9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquired lock "refresh_cache-9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290537.3060837, a569c652-6b15-4244-b011-1d09fbdd4281 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] VM Started (Lifecycle Event)
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Took 16.90 seconds to spawn the instance on the hypervisor.
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received event network-changed-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Refreshing instance network info cache due to event network-changed-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Acquiring lock "refresh_cache-9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.compute.manager [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Took 17.95 seconds to build instance.
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bab9375e-aa2b-4ba7-a4ab-ac4b02e5d534 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "a569c652-6b15-4244-b011-1d09fbdd4281" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.137s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.080s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.compute.claims [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Claim successful on node user
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.network.neutron [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:08:57 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:08:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:08:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Creating image(s)
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.164s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:08:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk 1073741824" returned: 0 in 0.061s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.policy [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:08:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Creating image(s)
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.170s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.245s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Cannot resize image /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.objects.instance [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'migration_context' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Updating instance_info_cache with network_info: [{"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Ensure instance console log exists: /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.policy [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Releasing lock "refresh_cache-9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Instance network_info: |[{"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Acquired lock "refresh_cache-9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.network.neutron [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Refreshing network info cache for port 04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:08:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Start _get_guest_xml network_info=[{"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:08:59 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:08:59 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1026602398',display_name='tempest-DeleteServersTestJSON-server-1026602398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1026602398',id=2,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c93767066d345a081bd30ca6d52ccd3',ramdisk_id='',reservation_id='r-gqu2qslg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-821159716',owner_user_name='tempest-DeleteServersTestJSON-821159716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:08:56Z,user_data=None,user_id='69a651c616da4b3b98a71a43b07512d9',uuid=9c107ac6-adbb-4e6d-835a-4f6e7fa6f185,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Converting VIF {"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:12,bridge_name='br-int',has_traffic_filtering=True,id=04ac7d1a-2c1d-4599-b8d7-5cfe5530f700,network=Network(c2c7e602-9c91-45a0-9625-07d734f10331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ac7d1a-2c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.196s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:08:59 user nova-compute[71482]:   <uuid>9c107ac6-adbb-4e6d-835a-4f6e7fa6f185</uuid>
Apr 12 09:08:59 user nova-compute[71482]:   <name>instance-00000002</name>
Apr 12 09:08:59 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:08:59 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:08:59 user nova-compute[71482]:   <metadata>
Apr 12 09:08:59 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:08:59 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:08:59 user nova-compute[71482]:       <nova:name>tempest-DeleteServersTestJSON-server-1026602398</nova:name>
Apr 12 09:08:59 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:08:59</nova:creationTime>
Apr 12 09:08:59 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:08:59 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:08:59 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:08:59 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:08:59 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:08:59 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:08:59 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:08:59 user nova-compute[71482]:       <nova:owner>
Apr 12 09:08:59 user nova-compute[71482]:         <nova:user uuid="69a651c616da4b3b98a71a43b07512d9">tempest-DeleteServersTestJSON-821159716-project-member</nova:user>
Apr 12 09:08:59 user nova-compute[71482]:         <nova:project uuid="2c93767066d345a081bd30ca6d52ccd3">tempest-DeleteServersTestJSON-821159716</nova:project>
Apr 12 09:08:59 user nova-compute[71482]:       </nova:owner>
Apr 12 09:08:59 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:08:59 user nova-compute[71482]:       <nova:ports>
Apr 12 09:08:59 user nova-compute[71482]:         <nova:port uuid="04ac7d1a-2c1d-4599-b8d7-5cfe5530f700">
Apr 12 09:08:59 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 09:08:59 user nova-compute[71482]:         </nova:port>
Apr 12 09:08:59 user nova-compute[71482]:       </nova:ports>
Apr 12 09:08:59 user nova-compute[71482]:     </nova:instance>
Apr 12 09:08:59 user nova-compute[71482]:   </metadata>
Apr 12 09:08:59 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:08:59 user nova-compute[71482]:     <system>
Apr 12 09:08:59 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:08:59 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:08:59 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:08:59 user nova-compute[71482]:       <entry name="serial">9c107ac6-adbb-4e6d-835a-4f6e7fa6f185</entry>
Apr 12 09:08:59 user nova-compute[71482]:       <entry name="uuid">9c107ac6-adbb-4e6d-835a-4f6e7fa6f185</entry>
Apr 12 09:08:59 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:08:59 user nova-compute[71482]:     </system>
Apr 12 09:08:59 user nova-compute[71482]:   </sysinfo>
Apr 12 09:08:59 user nova-compute[71482]:   <os>
Apr 12 09:08:59 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:08:59 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:08:59 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:08:59 user nova-compute[71482]:   </os>
Apr 12 09:08:59 user nova-compute[71482]:   <features>
Apr 12 09:08:59 user nova-compute[71482]:     <acpi/>
Apr 12 09:08:59 user nova-compute[71482]:     <apic/>
Apr 12 09:08:59 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:08:59 user nova-compute[71482]:   </features>
Apr 12 09:08:59 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:08:59 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:08:59 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:08:59 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:08:59 user nova-compute[71482]:   </clock>
Apr 12 09:08:59 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:08:59 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:08:59 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:08:59 user nova-compute[71482]:   </cpu>
Apr 12 09:08:59 user nova-compute[71482]:   <devices>
Apr 12 09:08:59 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:08:59 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:08:59 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk"/>
Apr 12 09:08:59 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:08:59 user nova-compute[71482]:     </disk>
Apr 12 09:08:59 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:08:59 user nova-compute[71482]:       <mac address="fa:16:3e:2e:ca:12"/>
Apr 12 09:08:59 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:08:59 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:08:59 user nova-compute[71482]:       <target dev="tap04ac7d1a-2c"/>
Apr 12 09:08:59 user nova-compute[71482]:     </interface>
Apr 12 09:08:59 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:08:59 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/console.log" append="off"/>
Apr 12 09:08:59 user nova-compute[71482]:     </serial>
Apr 12 09:08:59 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:08:59 user nova-compute[71482]:     <video>
Apr 12 09:08:59 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:08:59 user nova-compute[71482]:     </video>
Apr 12 09:08:59 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:08:59 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:08:59 user nova-compute[71482]:     </rng>
Apr 12 09:08:59 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:08:59 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:08:59 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:08:59 user nova-compute[71482]:     </memballoon>
Apr 12 09:08:59 user nova-compute[71482]:   </devices>
Apr 12 09:08:59 user nova-compute[71482]: </domain>
Apr 12 09:08:59 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1026602398',display_name='tempest-DeleteServersTestJSON-server-1026602398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1026602398',id=2,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c93767066d345a081bd30ca6d52ccd3',ramdisk_id='',reservation_id='r-gqu2qslg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-821159716',owner_user_name='tempest-DeleteServersTestJSON-821159716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:08:56Z,user_data=None,user_id='69a651c616da4b3b98a71a43b07512d9',uuid=9c107ac6-adbb-4e6d-835a-4f6e7fa6f185,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Converting VIF {"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:12,bridge_name='br-int',has_traffic_filtering=True,id=04ac7d1a-2c1d-4599-b8d7-5cfe5530f700,network=Network(c2c7e602-9c91-45a0-9625-07d734f10331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ac7d1a-2c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG os_vif [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:12,bridge_name='br-int',has_traffic_filtering=True,id=04ac7d1a-2c1d-4599-b8d7-5cfe5530f700,network=Network(c2c7e602-9c91-45a0-9625-07d734f10331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ac7d1a-2c') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk 1073741824" returned: 0 in 0.060s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ac7d1a-2c, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap04ac7d1a-2c, col_values=(('external_ids', {'iface-id': '04ac7d1a-2c1d-4599-b8d7-5cfe5530f700', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:ca:12', 'vm-uuid': '9c107ac6-adbb-4e6d-835a-4f6e7fa6f185'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:59 user nova-compute[71482]: INFO os_vif [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ca:12,bridge_name='br-int',has_traffic_filtering=True,id=04ac7d1a-2c1d-4599-b8d7-5cfe5530f700,network=Network(c2c7e602-9c91-45a0-9625-07d734f10331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ac7d1a-2c')
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] No VIF found with MAC fa:16:3e:2e:ca:12, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.200s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Cannot resize image /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'migration_context' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.compute.manager [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received event network-vif-plugged-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Acquiring lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.compute.manager [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] No waiting events found dispatching network-vif-plugged-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:08:59 user nova-compute[71482]: WARNING nova.compute.manager [req-8860b7d1-d442-4e85-8996-87cddd77f20d req-2eb496a5-32b0-4aab-9e81-c7ed70122813 service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received unexpected event network-vif-plugged-b2a3049a-cc8d-4804-854e-2451b7f886fd for instance with vm_state active and task_state None.
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Ensure instance console log exists: /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:08:59 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:08:59 user nova-compute[71482]: INFO nova.compute.claims [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Claim successful on node user
Apr 12 09:09:00 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.697s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:09:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:09:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:09:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Creating image(s)
Apr 12 09:09:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "/opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "/opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "/opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:09:01 user nova-compute[71482]: INFO nova.compute.claims [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Claim successful on node user
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.network.neutron [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Updated VIF entry in instance network info cache for port 04ac7d1a-2c1d-4599-b8d7-5cfe5530f700. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.network.neutron [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Updating instance_info_cache with network_info: [{"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-766fbce4-40ba-4868-8421-5e87f2af61fe req-d3ecf72b-8dfb-442c-901a-4cf03594dcd8 service nova] Releasing lock "refresh_cache-9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.179s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk 1073741824" returned: 0 in 0.081s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.policy [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.184s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.573s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received event network-vif-plugged-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] Acquiring lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] No waiting events found dispatching network-vif-plugged-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:01 user nova-compute[71482]: WARNING nova.compute.manager [req-93ebee64-9132-4328-9aca-884c1070ec8a req-6a6b9367-84bc-4e87-b195-de1d5b27e49a service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received unexpected event network-vif-plugged-b2a3049a-cc8d-4804-854e-2451b7f886fd for instance with vm_state active and task_state None.
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Cannot resize image /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.objects.instance [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'migration_context' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:01 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Ensure instance console log exists: /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:09:01 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Creating image(s)
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG nova.network.neutron [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Successfully created port: dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.209s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG nova.policy [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk 1073741824" returned: 0 in 0.088s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.164s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Cannot resize image /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'migration_context' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Ensure instance console log exists: /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290543.1427097, 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:03 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] VM Resumed (Lifecycle Event)
Apr 12 09:09:03 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Instance spawned successfully.
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:03 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290543.1496778, 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:03 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] VM Started (Lifecycle Event)
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:03 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:03 user nova-compute[71482]: INFO nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Took 7.55 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Successfully created port: a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:09:03 user nova-compute[71482]: INFO nova.compute.manager [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Took 8.29 seconds to build instance.
Apr 12 09:09:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3fe252bf-6dc4-4e24-9fdc-98b707777e9f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.460s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received event network-vif-plugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Acquiring lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] No waiting events found dispatching network-vif-plugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:03 user nova-compute[71482]: WARNING nova.compute.manager [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received unexpected event network-vif-plugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance with vm_state active and task_state None.
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received event network-vif-plugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Acquiring lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] No waiting events found dispatching network-vif-plugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:03 user nova-compute[71482]: WARNING nova.compute.manager [req-c6039589-f7b0-4965-ab39-69e14b45f422 req-7ee562e3-70a0-4f29-9cf9-177ef0b22aea service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received unexpected event network-vif-plugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance with vm_state active and task_state None.
Apr 12 09:09:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:05 user nova-compute[71482]: DEBUG nova.network.neutron [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Successfully created port: e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Successfully updated port: dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-changed-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Refreshing instance network info cache due to event network-changed-dc64c2a8-533c-40df-b88e-c059cb9cda89. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] Acquiring lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Successfully updated port: a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Successfully created port: 44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-changed-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Refreshing instance network info cache due to event network-changed-a9c92ca6-773e-40e3-ab31-710b4b495183. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] Acquiring lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] Acquired lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG nova.network.neutron [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Refreshing network info cache for port a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:09:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:07 user nova-compute[71482]: DEBUG nova.network.neutron [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:07 user nova-compute[71482]: DEBUG nova.network.neutron [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance network_info: |[{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:09:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] Acquired lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:07 user nova-compute[71482]: DEBUG nova.network.neutron [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Refreshing network info cache for port dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:09:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Start _get_guest_xml network_info=[{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:09:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-260276984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.objects.instance [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:09:08 user nova-compute[71482]:   <uuid>4f211820-161b-4bef-b25d-ced137325da1</uuid>
Apr 12 09:09:08 user nova-compute[71482]:   <name>instance-00000003</name>
Apr 12 09:09:08 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:09:08 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:09:08 user nova-compute[71482]:   <metadata>
Apr 12 09:09:08 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:09:08 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:09:08 user nova-compute[71482]:       <nova:name>tempest-ServerActionsTestJSON-server-260276984</nova:name>
Apr 12 09:09:08 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:09:08</nova:creationTime>
Apr 12 09:09:08 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:09:08 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:09:08 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:09:08 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:09:08 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:09:08 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:09:08 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:09:08 user nova-compute[71482]:       <nova:owner>
Apr 12 09:09:08 user nova-compute[71482]:         <nova:user uuid="375db5b9a80244d3878822049230ba47">tempest-ServerActionsTestJSON-1142062861-project-member</nova:user>
Apr 12 09:09:08 user nova-compute[71482]:         <nova:project uuid="20b8c89c46bb460f9f94be9426a22bb8">tempest-ServerActionsTestJSON-1142062861</nova:project>
Apr 12 09:09:08 user nova-compute[71482]:       </nova:owner>
Apr 12 09:09:08 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:09:08 user nova-compute[71482]:       <nova:ports>
Apr 12 09:09:08 user nova-compute[71482]:         <nova:port uuid="dc64c2a8-533c-40df-b88e-c059cb9cda89">
Apr 12 09:09:08 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 09:09:08 user nova-compute[71482]:         </nova:port>
Apr 12 09:09:08 user nova-compute[71482]:       </nova:ports>
Apr 12 09:09:08 user nova-compute[71482]:     </nova:instance>
Apr 12 09:09:08 user nova-compute[71482]:   </metadata>
Apr 12 09:09:08 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:09:08 user nova-compute[71482]:     <system>
Apr 12 09:09:08 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:09:08 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:09:08 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:09:08 user nova-compute[71482]:       <entry name="serial">4f211820-161b-4bef-b25d-ced137325da1</entry>
Apr 12 09:09:08 user nova-compute[71482]:       <entry name="uuid">4f211820-161b-4bef-b25d-ced137325da1</entry>
Apr 12 09:09:08 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:09:08 user nova-compute[71482]:     </system>
Apr 12 09:09:08 user nova-compute[71482]:   </sysinfo>
Apr 12 09:09:08 user nova-compute[71482]:   <os>
Apr 12 09:09:08 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:09:08 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:09:08 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:09:08 user nova-compute[71482]:   </os>
Apr 12 09:09:08 user nova-compute[71482]:   <features>
Apr 12 09:09:08 user nova-compute[71482]:     <acpi/>
Apr 12 09:09:08 user nova-compute[71482]:     <apic/>
Apr 12 09:09:08 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:09:08 user nova-compute[71482]:   </features>
Apr 12 09:09:08 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:09:08 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:09:08 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:09:08 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:09:08 user nova-compute[71482]:   </clock>
Apr 12 09:09:08 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:09:08 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:09:08 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:09:08 user nova-compute[71482]:   </cpu>
Apr 12 09:09:08 user nova-compute[71482]:   <devices>
Apr 12 09:09:08 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:09:08 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:09:08 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk"/>
Apr 12 09:09:08 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:09:08 user nova-compute[71482]:     </disk>
Apr 12 09:09:08 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:09:08 user nova-compute[71482]:       <mac address="fa:16:3e:9b:4e:53"/>
Apr 12 09:09:08 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:08 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:09:08 user nova-compute[71482]:       <target dev="tapdc64c2a8-53"/>
Apr 12 09:09:08 user nova-compute[71482]:     </interface>
Apr 12 09:09:08 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:09:08 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/console.log" append="off"/>
Apr 12 09:09:08 user nova-compute[71482]:     </serial>
Apr 12 09:09:08 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:09:08 user nova-compute[71482]:     <video>
Apr 12 09:09:08 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:08 user nova-compute[71482]:     </video>
Apr 12 09:09:08 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:09:08 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:09:08 user nova-compute[71482]:     </rng>
Apr 12 09:09:08 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:09:08 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:09:08 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:09:08 user nova-compute[71482]:     </memballoon>
Apr 12 09:09:08 user nova-compute[71482]:   </devices>
Apr 12 09:09:08 user nova-compute[71482]: </domain>
Apr 12 09:09:08 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-260276984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:08:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG os_vif [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.network.neutron [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc64c2a8-53, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc64c2a8-53, col_values=(('external_ids', {'iface-id': 'dc64c2a8-533c-40df-b88e-c059cb9cda89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:4e:53', 'vm-uuid': '4f211820-161b-4bef-b25d-ced137325da1'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fd5e36ac-4c43-47cd-9f87-767b87cf8013 req-d5a8260a-c646-4d9b-9d34-ffd4831e773f service nova] Releasing lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquired lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:08 user nova-compute[71482]: INFO os_vif [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53')
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No VIF found with MAC fa:16:3e:9b:4e:53, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.network.neutron [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Successfully updated port: e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquired lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.network.neutron [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-changed-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Refreshing instance network info cache due to event network-changed-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:09:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] Acquiring lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:09 user nova-compute[71482]: DEBUG nova.network.neutron [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updated VIF entry in instance network info cache for port dc64c2a8-533c-40df-b88e-c059cb9cda89. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:09:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-830c434d-74f9-4c7d-96d3-e0f7cb68ee64 req-d5ef92f5-972f-4d02-9c67-109a2223a76e service nova] Releasing lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Successfully updated port: 44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquired lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-changed-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Refreshing instance network info cache due to event network-changed-44c4d894-3c30-4528-95cd-37f612257156. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] Acquiring lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updating instance_info_cache with network_info: [{"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Releasing lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance network_info: |[{"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Start _get_guest_xml network_info=[{"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:09:10 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:10 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1294510131',display_name='tempest-ServerRescueNegativeTestJSON-server-1294510131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1294510131',id=4,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-fq7jpw7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:08:59Z,user_data=None,user_id='7f6b983634234693ba04a3097c2a129b',uuid=4a835849-83a7-457d-a96d-0acaa5a4a964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a9c92ca6-773e-40e3-ab31-710b4b495183,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c92ca6-77') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:09:10 user nova-compute[71482]:   <uuid>4a835849-83a7-457d-a96d-0acaa5a4a964</uuid>
Apr 12 09:09:10 user nova-compute[71482]:   <name>instance-00000004</name>
Apr 12 09:09:10 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:09:10 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:09:10 user nova-compute[71482]:   <metadata>
Apr 12 09:09:10 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:09:10 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1294510131</nova:name>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:09:10</nova:creationTime>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:09:10 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:09:10 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:owner>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:user uuid="7f6b983634234693ba04a3097c2a129b">tempest-ServerRescueNegativeTestJSON-480181232-project-member</nova:user>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:project uuid="1c3cc8ab6ab244b1badb6fea347d64ea">tempest-ServerRescueNegativeTestJSON-480181232</nova:project>
Apr 12 09:09:10 user nova-compute[71482]:       </nova:owner>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:ports>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:port uuid="a9c92ca6-773e-40e3-ab31-710b4b495183">
Apr 12 09:09:10 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:09:10 user nova-compute[71482]:         </nova:port>
Apr 12 09:09:10 user nova-compute[71482]:       </nova:ports>
Apr 12 09:09:10 user nova-compute[71482]:     </nova:instance>
Apr 12 09:09:10 user nova-compute[71482]:   </metadata>
Apr 12 09:09:10 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:09:10 user nova-compute[71482]:     <system>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="serial">4a835849-83a7-457d-a96d-0acaa5a4a964</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="uuid">4a835849-83a7-457d-a96d-0acaa5a4a964</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:09:10 user nova-compute[71482]:     </system>
Apr 12 09:09:10 user nova-compute[71482]:   </sysinfo>
Apr 12 09:09:10 user nova-compute[71482]:   <os>
Apr 12 09:09:10 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:09:10 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:09:10 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:09:10 user nova-compute[71482]:   </os>
Apr 12 09:09:10 user nova-compute[71482]:   <features>
Apr 12 09:09:10 user nova-compute[71482]:     <acpi/>
Apr 12 09:09:10 user nova-compute[71482]:     <apic/>
Apr 12 09:09:10 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:09:10 user nova-compute[71482]:   </features>
Apr 12 09:09:10 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:09:10 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:09:10 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:09:10 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:09:10 user nova-compute[71482]:   </clock>
Apr 12 09:09:10 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:09:10 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:09:10 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:09:10 user nova-compute[71482]:   </cpu>
Apr 12 09:09:10 user nova-compute[71482]:   <devices>
Apr 12 09:09:10 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:09:10 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:09:10 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk"/>
Apr 12 09:09:10 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:09:10 user nova-compute[71482]:     </disk>
Apr 12 09:09:10 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:09:10 user nova-compute[71482]:       <mac address="fa:16:3e:4b:70:8c"/>
Apr 12 09:09:10 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:10 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:09:10 user nova-compute[71482]:       <target dev="tapa9c92ca6-77"/>
Apr 12 09:09:10 user nova-compute[71482]:     </interface>
Apr 12 09:09:10 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:09:10 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/console.log" append="off"/>
Apr 12 09:09:10 user nova-compute[71482]:     </serial>
Apr 12 09:09:10 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:09:10 user nova-compute[71482]:     <video>
Apr 12 09:09:10 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:10 user nova-compute[71482]:     </video>
Apr 12 09:09:10 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:09:10 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:09:10 user nova-compute[71482]:     </rng>
Apr 12 09:09:10 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:09:10 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:09:10 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:09:10 user nova-compute[71482]:     </memballoon>
Apr 12 09:09:10 user nova-compute[71482]:   </devices>
Apr 12 09:09:10 user nova-compute[71482]: </domain>
Apr 12 09:09:10 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1294510131',display_name='tempest-ServerRescueNegativeTestJSON-server-1294510131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1294510131',id=4,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-fq7jpw7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:08:59Z,user_data=None,user_id='7f6b983634234693ba04a3097c2a129b',uuid=4a835849-83a7-457d-a96d-0acaa5a4a964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a9c92ca6-773e-40e3-ab31-710b4b495183,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c92ca6-77') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG os_vif [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a9c92ca6-773e-40e3-ab31-710b4b495183,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c92ca6-77') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9c92ca6-77, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa9c92ca6-77, col_values=(('external_ids', {'iface-id': 'a9c92ca6-773e-40e3-ab31-710b4b495183', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:70:8c', 'vm-uuid': '4a835849-83a7-457d-a96d-0acaa5a4a964'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: INFO os_vif [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a9c92ca6-773e-40e3-ab31-710b4b495183,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c92ca6-77')
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No VIF found with MAC fa:16:3e:4b:70:8c, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updating instance_info_cache with network_info: [{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Releasing lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance network_info: |[{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] Acquired lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.neutron [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Refreshing network info cache for port e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Start _get_guest_xml network_info=[{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:10 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-9128142',display_name='tempest-AttachVolumeTestJSON-server-9128142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-9128142',id=5,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w==',key_name='tempest-keypair-2058620837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-hp2b9h01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=f683bc12-8fca-47de-b28e-a0070e77b387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.objects.instance [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'pci_devices' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:09:10 user nova-compute[71482]:   <uuid>f683bc12-8fca-47de-b28e-a0070e77b387</uuid>
Apr 12 09:09:10 user nova-compute[71482]:   <name>instance-00000005</name>
Apr 12 09:09:10 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:09:10 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:09:10 user nova-compute[71482]:   <metadata>
Apr 12 09:09:10 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:09:10 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeTestJSON-server-9128142</nova:name>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:09:10</nova:creationTime>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:09:10 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:09:10 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:owner>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:user uuid="2a3731bf575c44d89211709cb07060b7">tempest-AttachVolumeTestJSON-1252670961-project-member</nova:user>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:project uuid="23e6ce78ce3d4eb5b4bbb307665c3670">tempest-AttachVolumeTestJSON-1252670961</nova:project>
Apr 12 09:09:10 user nova-compute[71482]:       </nova:owner>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:09:10 user nova-compute[71482]:       <nova:ports>
Apr 12 09:09:10 user nova-compute[71482]:         <nova:port uuid="e957a8ce-db60-4c11-8fcf-6b88d77e8e4f">
Apr 12 09:09:10 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 09:09:10 user nova-compute[71482]:         </nova:port>
Apr 12 09:09:10 user nova-compute[71482]:       </nova:ports>
Apr 12 09:09:10 user nova-compute[71482]:     </nova:instance>
Apr 12 09:09:10 user nova-compute[71482]:   </metadata>
Apr 12 09:09:10 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:09:10 user nova-compute[71482]:     <system>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="serial">f683bc12-8fca-47de-b28e-a0070e77b387</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="uuid">f683bc12-8fca-47de-b28e-a0070e77b387</entry>
Apr 12 09:09:10 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:09:10 user nova-compute[71482]:     </system>
Apr 12 09:09:10 user nova-compute[71482]:   </sysinfo>
Apr 12 09:09:10 user nova-compute[71482]:   <os>
Apr 12 09:09:10 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:09:10 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:09:10 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:09:10 user nova-compute[71482]:   </os>
Apr 12 09:09:10 user nova-compute[71482]:   <features>
Apr 12 09:09:10 user nova-compute[71482]:     <acpi/>
Apr 12 09:09:10 user nova-compute[71482]:     <apic/>
Apr 12 09:09:10 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:09:10 user nova-compute[71482]:   </features>
Apr 12 09:09:10 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:09:10 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:09:10 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:09:10 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:09:10 user nova-compute[71482]:   </clock>
Apr 12 09:09:10 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:09:10 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:09:10 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:09:10 user nova-compute[71482]:   </cpu>
Apr 12 09:09:10 user nova-compute[71482]:   <devices>
Apr 12 09:09:10 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:09:10 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:09:10 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk"/>
Apr 12 09:09:10 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:09:10 user nova-compute[71482]:     </disk>
Apr 12 09:09:10 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:09:10 user nova-compute[71482]:       <mac address="fa:16:3e:f3:e5:20"/>
Apr 12 09:09:10 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:10 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:09:10 user nova-compute[71482]:       <target dev="tape957a8ce-db"/>
Apr 12 09:09:10 user nova-compute[71482]:     </interface>
Apr 12 09:09:10 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:09:10 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/console.log" append="off"/>
Apr 12 09:09:10 user nova-compute[71482]:     </serial>
Apr 12 09:09:10 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:09:10 user nova-compute[71482]:     <video>
Apr 12 09:09:10 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:10 user nova-compute[71482]:     </video>
Apr 12 09:09:10 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:09:10 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:09:10 user nova-compute[71482]:     </rng>
Apr 12 09:09:10 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:09:10 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:09:10 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:09:10 user nova-compute[71482]:     </memballoon>
Apr 12 09:09:10 user nova-compute[71482]:   </devices>
Apr 12 09:09:10 user nova-compute[71482]: </domain>
Apr 12 09:09:10 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-9128142',display_name='tempest-AttachVolumeTestJSON-server-9128142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-9128142',id=5,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w==',key_name='tempest-keypair-2058620837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-hp2b9h01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=f683bc12-8fca-47de-b28e-a0070e77b387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG os_vif [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape957a8ce-db, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape957a8ce-db, col_values=(('external_ids', {'iface-id': 'e957a8ce-db60-4c11-8fcf-6b88d77e8e4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:e5:20', 'vm-uuid': 'f683bc12-8fca-47de-b28e-a0070e77b387'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:10 user nova-compute[71482]: INFO os_vif [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db')
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updating instance_info_cache with network_info: [{"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No VIF found with MAC fa:16:3e:f3:e5:20, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Releasing lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Instance network_info: |[{"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] Acquired lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.neutron [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Refreshing network info cache for port 44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Start _get_guest_xml network_info=[{"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:09:10 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:10 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967968381',display_name='tempest-ServerRescueNegativeTestJSON-server-1967968381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967968381',id=6,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-0hs4rd5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:02Z,user_data=None,user_id='7f6b983634234693ba04a3097c2a129b',uuid=6f58bf6a-beec-40e5-b8be-de03539038f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4d894-3c30-4528-95cd-37f612257156,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4d894-3c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:10 user nova-compute[71482]: DEBUG nova.objects.instance [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:09:11 user nova-compute[71482]:   <uuid>6f58bf6a-beec-40e5-b8be-de03539038f8</uuid>
Apr 12 09:09:11 user nova-compute[71482]:   <name>instance-00000006</name>
Apr 12 09:09:11 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:09:11 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:09:11 user nova-compute[71482]:   <metadata>
Apr 12 09:09:11 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:09:11 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:09:11 user nova-compute[71482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1967968381</nova:name>
Apr 12 09:09:11 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:09:10</nova:creationTime>
Apr 12 09:09:11 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:09:11 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:09:11 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:09:11 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:09:11 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:09:11 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:09:11 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:09:11 user nova-compute[71482]:       <nova:owner>
Apr 12 09:09:11 user nova-compute[71482]:         <nova:user uuid="7f6b983634234693ba04a3097c2a129b">tempest-ServerRescueNegativeTestJSON-480181232-project-member</nova:user>
Apr 12 09:09:11 user nova-compute[71482]:         <nova:project uuid="1c3cc8ab6ab244b1badb6fea347d64ea">tempest-ServerRescueNegativeTestJSON-480181232</nova:project>
Apr 12 09:09:11 user nova-compute[71482]:       </nova:owner>
Apr 12 09:09:11 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:09:11 user nova-compute[71482]:       <nova:ports>
Apr 12 09:09:11 user nova-compute[71482]:         <nova:port uuid="44c4d894-3c30-4528-95cd-37f612257156">
Apr 12 09:09:11 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 09:09:11 user nova-compute[71482]:         </nova:port>
Apr 12 09:09:11 user nova-compute[71482]:       </nova:ports>
Apr 12 09:09:11 user nova-compute[71482]:     </nova:instance>
Apr 12 09:09:11 user nova-compute[71482]:   </metadata>
Apr 12 09:09:11 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:09:11 user nova-compute[71482]:     <system>
Apr 12 09:09:11 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:09:11 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:09:11 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:09:11 user nova-compute[71482]:       <entry name="serial">6f58bf6a-beec-40e5-b8be-de03539038f8</entry>
Apr 12 09:09:11 user nova-compute[71482]:       <entry name="uuid">6f58bf6a-beec-40e5-b8be-de03539038f8</entry>
Apr 12 09:09:11 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:09:11 user nova-compute[71482]:     </system>
Apr 12 09:09:11 user nova-compute[71482]:   </sysinfo>
Apr 12 09:09:11 user nova-compute[71482]:   <os>
Apr 12 09:09:11 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:09:11 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:09:11 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:09:11 user nova-compute[71482]:   </os>
Apr 12 09:09:11 user nova-compute[71482]:   <features>
Apr 12 09:09:11 user nova-compute[71482]:     <acpi/>
Apr 12 09:09:11 user nova-compute[71482]:     <apic/>
Apr 12 09:09:11 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:09:11 user nova-compute[71482]:   </features>
Apr 12 09:09:11 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:09:11 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:09:11 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:09:11 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:09:11 user nova-compute[71482]:   </clock>
Apr 12 09:09:11 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:09:11 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:09:11 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:09:11 user nova-compute[71482]:   </cpu>
Apr 12 09:09:11 user nova-compute[71482]:   <devices>
Apr 12 09:09:11 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:09:11 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:09:11 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk"/>
Apr 12 09:09:11 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:09:11 user nova-compute[71482]:     </disk>
Apr 12 09:09:11 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:09:11 user nova-compute[71482]:       <mac address="fa:16:3e:04:2d:9f"/>
Apr 12 09:09:11 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:11 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:09:11 user nova-compute[71482]:       <target dev="tap44c4d894-3c"/>
Apr 12 09:09:11 user nova-compute[71482]:     </interface>
Apr 12 09:09:11 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:09:11 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/console.log" append="off"/>
Apr 12 09:09:11 user nova-compute[71482]:     </serial>
Apr 12 09:09:11 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:09:11 user nova-compute[71482]:     <video>
Apr 12 09:09:11 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:11 user nova-compute[71482]:     </video>
Apr 12 09:09:11 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:09:11 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:09:11 user nova-compute[71482]:     </rng>
Apr 12 09:09:11 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:09:11 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:09:11 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:09:11 user nova-compute[71482]:     </memballoon>
Apr 12 09:09:11 user nova-compute[71482]:   </devices>
Apr 12 09:09:11 user nova-compute[71482]: </domain>
Apr 12 09:09:11 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967968381',display_name='tempest-ServerRescueNegativeTestJSON-server-1967968381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967968381',id=6,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-0hs4rd5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:02Z,user_data=None,user_id='7f6b983634234693ba04a3097c2a129b',uuid=6f58bf6a-beec-40e5-b8be-de03539038f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4d894-3c30-4528-95cd-37f612257156,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4d894-3c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG os_vif [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4d894-3c30-4528-95cd-37f612257156,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4d894-3c') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44c4d894-3c, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44c4d894-3c, col_values=(('external_ids', {'iface-id': '44c4d894-3c30-4528-95cd-37f612257156', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:2d:9f', 'vm-uuid': '6f58bf6a-beec-40e5-b8be-de03539038f8'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:11 user nova-compute[71482]: INFO os_vif [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4d894-3c30-4528-95cd-37f612257156,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4d894-3c')
Apr 12 09:09:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No VIF found with MAC fa:16:3e:04:2d:9f, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:11 user nova-compute[71482]: WARNING nova.compute.manager [req-df647874-dd69-4cbf-ac01-5e013a752621 req-6ac51413-926e-46a8-9acb-f27f7a4adcd7 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state building and task_state spawning.
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290552.2284913, 4f211820-161b-4bef-b25d-ced137325da1 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:12 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Resumed (Lifecycle Event)
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:12 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance spawned successfully.
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:12 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290552.2362394, 4f211820-161b-4bef-b25d-ced137325da1 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:12 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Started (Lifecycle Event)
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:12 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:12 user nova-compute[71482]: INFO nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Took 14.29 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:12 user nova-compute[71482]: INFO nova.compute.manager [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Took 15.28 seconds to build instance.
Apr 12 09:09:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-923dcaa9-5b49-4561-8f20-50d16e694b69 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.424s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.network.neutron [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updated VIF entry in instance network info cache for port e957a8ce-db60-4c11-8fcf-6b88d77e8e4f. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.network.neutron [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updating instance_info_cache with network_info: [{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-06ceb100-4eb7-4b86-9980-c01d03009dc8 req-67bc4a87-2499-439a-87c5-22fa3f934712 service nova] Releasing lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.network.neutron [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updated VIF entry in instance network info cache for port 44c4d894-3c30-4528-95cd-37f612257156. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG nova.network.neutron [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updating instance_info_cache with network_info: [{"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2ba30934-40ec-407d-83fe-2782ad3b3316 req-ea063277-86ad-4784-95f5-50cd22d3f142 service nova] Releasing lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:14 user nova-compute[71482]: WARNING nova.compute.manager [req-cb7066ec-387e-4021-ab1f-c4278877db49 req-77fde680-a5f6-4128-8bea-a7856fb45aeb service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state None.
Apr 12 09:09:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:17 user nova-compute[71482]: WARNING nova.compute.manager [req-061f15f5-9177-48f2-ba93-25f64788cabe req-01f6836a-454b-4510-bf37-f9263222f8f7 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state building and task_state spawning.
Apr 12 09:09:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:09:18 user nova-compute[71482]: INFO nova.compute.claims [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Claim successful on node user
Apr 12 09:09:18 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290558.9169083, f683bc12-8fca-47de-b28e-a0070e77b387 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:18 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] VM Resumed (Lifecycle Event)
Apr 12 09:09:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.709s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:09:18 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance spawned successfully.
Apr 12 09:09:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290558.9314733, f683bc12-8fca-47de-b28e-a0070e77b387 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] VM Started (Lifecycle Event)
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290559.1046097, 4a835849-83a7-457d-a96d-0acaa5a4a964 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] VM Resumed (Lifecycle Event)
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance spawned successfully.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Instance spawned successfully.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290559.104873, 4a835849-83a7-457d-a96d-0acaa5a4a964 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] VM Started (Lifecycle Event)
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Took 18.35 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.policy [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df9257c2223d417298b5927f7b99ac07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f74eae85c24a72a048bdd03e4d4f19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290559.1364193, 6f58bf6a-beec-40e5-b8be-de03539038f8 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] VM Resumed (Lifecycle Event)
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Took 20.82 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Took 19.88 seconds to build instance.
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Took 17.69 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290559.2119663, 6f58bf6a-beec-40e5-b8be-de03539038f8 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] VM Started (Lifecycle Event)
Apr 12 09:09:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-83843321-7124-4b2f-a678-706d3380db7d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.180s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Creating image(s)
Apr 12 09:09:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "/opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "/opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "/opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:19 user nova-compute[71482]: INFO nova.compute.manager [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Took 22.30 seconds to build instance.
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:20 user nova-compute[71482]: WARNING nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state active and task_state None.
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:20 user nova-compute[71482]: WARNING nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state building and task_state spawning.
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:20 user nova-compute[71482]: WARNING nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state building and task_state spawning.
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] No waiting events found dispatching network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:20 user nova-compute[71482]: WARNING nova.compute.manager [req-e13d523d-420c-4c50-8c47-fc5686a09057 req-f7f0b653-5901-4d92-a850-e3cf1fc45daf service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received unexpected event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 for instance with vm_state building and task_state spawning.
Apr 12 09:09:20 user nova-compute[71482]: INFO nova.compute.manager [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Took 19.11 seconds to build instance.
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.217s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e97c0ac7-26a7-4d7d-8b1f-0acf825d922d tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.630s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-609babf8-6b14-4a82-b4f4-136644739001 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.349s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.268s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk 1073741824" returned: 0 in 0.071s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Successfully created port: d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.351s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:09:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Cannot resize image /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG nova.objects.instance [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lazy-loading 'migration_context' on Instance uuid 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Ensure instance console log exists: /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Successfully updated port: d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "refresh_cache-94f40323-58a6-4e9c-b26b-23615dde13d3" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquired lock "refresh_cache-94f40323-58a6-4e9c-b26b-23615dde13d3" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received event network-changed-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Refreshing instance network info cache due to event network-changed-d3cd67b3-275a-4eef-b0c5-b2da33a783f9. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:09:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] Acquiring lock "refresh_cache-94f40323-58a6-4e9c-b26b-23615dde13d3" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] No waiting events found dispatching network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:22 user nova-compute[71482]: WARNING nova.compute.manager [req-2cf1c0d8-c0c4-48fa-a0f6-e67835588346 req-68cfecf7-76b6-4e3f-9a19-1c366b39a217 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received unexpected event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 for instance with vm_state active and task_state None.
Apr 12 09:09:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:22 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:09:22 user nova-compute[71482]: INFO nova.compute.claims [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Claim successful on node user
Apr 12 09:09:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Updating instance_info_cache with network_info: [{"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Releasing lock "refresh_cache-94f40323-58a6-4e9c-b26b-23615dde13d3" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Instance network_info: |[{"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] Acquired lock "refresh_cache-94f40323-58a6-4e9c-b26b-23615dde13d3" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.network.neutron [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Refreshing network info cache for port d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Start _get_guest_xml network_info=[{"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:09:23 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:23 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:09:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2129617709',display_name='tempest-TestVolumeSwap-server-2129617709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2129617709',id=7,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm8EQfriZimJKZoTG24j09PT/XZoMDm7SAU3ypiuEbNdxZ7SDdwTjNlIAeyrJyWOC6PfocSe31LVOsrXRfE2T4ylMmBcmnO+zWFD54VyS6dBRK8fJqLCAXg2n2r8fndkQ==',key_name='tempest-keypair-1337351931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70f74eae85c24a72a048bdd03e4d4f19',ramdisk_id='',reservation_id='r-g70ucqhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1881322649',owner_user_name='tempest-TestVolumeSwap-1881322649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9257c2223d417298b5927f7b99ac07',uuid=94f40323-58a6-4e9c-b26b-23615dde13d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Converting VIF {"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:c0:df,bridge_name='br-int',has_traffic_filtering=True,id=d3cd67b3-275a-4eef-b0c5-b2da33a783f9,network=Network(ece9cc91-9a3c-48d7-bce4-760fc01a51f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cd67b3-27') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.objects.instance [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lazy-loading 'pci_devices' on Instance uuid 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:09:23 user nova-compute[71482]:   <uuid>94f40323-58a6-4e9c-b26b-23615dde13d3</uuid>
Apr 12 09:09:23 user nova-compute[71482]:   <name>instance-00000007</name>
Apr 12 09:09:23 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:09:23 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:09:23 user nova-compute[71482]:   <metadata>
Apr 12 09:09:23 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:09:23 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:09:23 user nova-compute[71482]:       <nova:name>tempest-TestVolumeSwap-server-2129617709</nova:name>
Apr 12 09:09:23 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:09:23</nova:creationTime>
Apr 12 09:09:23 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:09:23 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:09:23 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:09:23 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:09:23 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:09:23 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:09:23 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:09:23 user nova-compute[71482]:       <nova:owner>
Apr 12 09:09:23 user nova-compute[71482]:         <nova:user uuid="df9257c2223d417298b5927f7b99ac07">tempest-TestVolumeSwap-1881322649-project-member</nova:user>
Apr 12 09:09:23 user nova-compute[71482]:         <nova:project uuid="70f74eae85c24a72a048bdd03e4d4f19">tempest-TestVolumeSwap-1881322649</nova:project>
Apr 12 09:09:23 user nova-compute[71482]:       </nova:owner>
Apr 12 09:09:23 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:09:23 user nova-compute[71482]:       <nova:ports>
Apr 12 09:09:23 user nova-compute[71482]:         <nova:port uuid="d3cd67b3-275a-4eef-b0c5-b2da33a783f9">
Apr 12 09:09:23 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 09:09:23 user nova-compute[71482]:         </nova:port>
Apr 12 09:09:23 user nova-compute[71482]:       </nova:ports>
Apr 12 09:09:23 user nova-compute[71482]:     </nova:instance>
Apr 12 09:09:23 user nova-compute[71482]:   </metadata>
Apr 12 09:09:23 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:09:23 user nova-compute[71482]:     <system>
Apr 12 09:09:23 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:09:23 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:09:23 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:09:23 user nova-compute[71482]:       <entry name="serial">94f40323-58a6-4e9c-b26b-23615dde13d3</entry>
Apr 12 09:09:23 user nova-compute[71482]:       <entry name="uuid">94f40323-58a6-4e9c-b26b-23615dde13d3</entry>
Apr 12 09:09:23 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:09:23 user nova-compute[71482]:     </system>
Apr 12 09:09:23 user nova-compute[71482]:   </sysinfo>
Apr 12 09:09:23 user nova-compute[71482]:   <os>
Apr 12 09:09:23 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:09:23 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:09:23 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:09:23 user nova-compute[71482]:   </os>
Apr 12 09:09:23 user nova-compute[71482]:   <features>
Apr 12 09:09:23 user nova-compute[71482]:     <acpi/>
Apr 12 09:09:23 user nova-compute[71482]:     <apic/>
Apr 12 09:09:23 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:09:23 user nova-compute[71482]:   </features>
Apr 12 09:09:23 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:09:23 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:09:23 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:09:23 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:09:23 user nova-compute[71482]:   </clock>
Apr 12 09:09:23 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:09:23 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:09:23 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:09:23 user nova-compute[71482]:   </cpu>
Apr 12 09:09:23 user nova-compute[71482]:   <devices>
Apr 12 09:09:23 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:09:23 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:09:23 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk"/>
Apr 12 09:09:23 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:09:23 user nova-compute[71482]:     </disk>
Apr 12 09:09:23 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:09:23 user nova-compute[71482]:       <mac address="fa:16:3e:e7:c0:df"/>
Apr 12 09:09:23 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:23 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:09:23 user nova-compute[71482]:       <target dev="tapd3cd67b3-27"/>
Apr 12 09:09:23 user nova-compute[71482]:     </interface>
Apr 12 09:09:23 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:09:23 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/console.log" append="off"/>
Apr 12 09:09:23 user nova-compute[71482]:     </serial>
Apr 12 09:09:23 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:09:23 user nova-compute[71482]:     <video>
Apr 12 09:09:23 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:23 user nova-compute[71482]:     </video>
Apr 12 09:09:23 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:09:23 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:09:23 user nova-compute[71482]:     </rng>
Apr 12 09:09:23 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:09:23 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:09:23 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:09:23 user nova-compute[71482]:     </memballoon>
Apr 12 09:09:23 user nova-compute[71482]:   </devices>
Apr 12 09:09:23 user nova-compute[71482]: </domain>
Apr 12 09:09:23 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:09:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2129617709',display_name='tempest-TestVolumeSwap-server-2129617709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2129617709',id=7,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm8EQfriZimJKZoTG24j09PT/XZoMDm7SAU3ypiuEbNdxZ7SDdwTjNlIAeyrJyWOC6PfocSe31LVOsrXRfE2T4ylMmBcmnO+zWFD54VyS6dBRK8fJqLCAXg2n2r8fndkQ==',key_name='tempest-keypair-1337351931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70f74eae85c24a72a048bdd03e4d4f19',ramdisk_id='',reservation_id='r-g70ucqhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1881322649',owner_user_name='tempest-TestVolumeSwap-1881322649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9257c2223d417298b5927f7b99ac07',uuid=94f40323-58a6-4e9c-b26b-23615dde13d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Converting VIF {"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:c0:df,bridge_name='br-int',has_traffic_filtering=True,id=d3cd67b3-275a-4eef-b0c5-b2da33a783f9,network=Network(ece9cc91-9a3c-48d7-bce4-760fc01a51f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cd67b3-27') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG os_vif [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:c0:df,bridge_name='br-int',has_traffic_filtering=True,id=d3cd67b3-275a-4eef-b0c5-b2da33a783f9,network=Network(ece9cc91-9a3c-48d7-bce4-760fc01a51f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cd67b3-27') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3cd67b3-27, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3cd67b3-27, col_values=(('external_ids', {'iface-id': 'd3cd67b3-275a-4eef-b0c5-b2da33a783f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:c0:df', 'vm-uuid': '94f40323-58a6-4e9c-b26b-23615dde13d3'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:23 user nova-compute[71482]: INFO os_vif [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:c0:df,bridge_name='br-int',has_traffic_filtering=True,id=d3cd67b3-275a-4eef-b0c5-b2da33a783f9,network=Network(ece9cc91-9a3c-48d7-bce4-760fc01a51f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cd67b3-27')
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] No VIF found with MAC fa:16:3e:e7:c0:df, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.920s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:09:23 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.network.neutron [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Updated VIF entry in instance network info cache for port d3cd67b3-275a-4eef-b0c5-b2da33a783f9. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:09:23 user nova-compute[71482]: DEBUG nova.network.neutron [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Updating instance_info_cache with network_info: [{"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-14ba1720-2a20-411d-bd35-9c1c92270760 req-5a757c77-1a7a-4a0b-b9e6-e11f313be45e service nova] Releasing lock "refresh_cache-94f40323-58a6-4e9c-b26b-23615dde13d3" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG nova.policy [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8911ec7c959541989cce3870ba11fb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e7d6ece244a96b01277451a3ed5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:09:24 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Creating image(s)
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "/opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "/opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.175s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.296s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk 1073741824" returned: 0 in 0.117s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.425s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.260s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:09:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Cannot resize image /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG nova.objects.instance [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'migration_context' on Instance uuid 1d0bc5da-ed98-417a-9fc1-1f636887f035 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Ensure instance console log exists: /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received event network-vif-plugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] No waiting events found dispatching network-vif-plugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:26 user nova-compute[71482]: WARNING nova.compute.manager [req-1b08b1a8-35c1-46c0-b8d9-5de13c87f84a req-35d3a608-41d2-401c-86e2-eec45ca944c3 service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received unexpected event network-vif-plugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance with vm_state building and task_state spawning.
Apr 12 09:09:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Successfully created port: 473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:09:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290568.5340898, 94f40323-58a6-4e9c-b26b-23615dde13d3 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:28 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] VM Resumed (Lifecycle Event)
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:28 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Instance spawned successfully.
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:28 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290568.5504026, 94f40323-58a6-4e9c-b26b-23615dde13d3 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:28 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] VM Started (Lifecycle Event)
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received event network-vif-plugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] No waiting events found dispatching network-vif-plugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:28 user nova-compute[71482]: WARNING nova.compute.manager [req-3be5ab74-c1db-4fce-8c8c-26492d90fa01 req-e4cbd5c0-35fc-447c-bc57-600de9a7af4c service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received unexpected event network-vif-plugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance with vm_state building and task_state spawning.
Apr 12 09:09:28 user nova-compute[71482]: INFO nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Took 9.03 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:28 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:29 user nova-compute[71482]: INFO nova.compute.manager [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Took 10.83 seconds to build instance.
Apr 12 09:09:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4241a4c2-6e1d-4977-abf5-0065e6fd28ca tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.325s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:09:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:09:29 user nova-compute[71482]: INFO nova.compute.claims [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Claim successful on node user
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:09:30 user nova-compute[71482]: INFO nova.compute.claims [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Claim successful on node user
Apr 12 09:09:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:09:30 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.network.neutron [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Successfully updated port: 473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.policy [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "refresh_cache-1d0bc5da-ed98-417a-9fc1-1f636887f035" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquired lock "refresh_cache-1d0bc5da-ed98-417a-9fc1-1f636887f035" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.network.neutron [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received event network-changed-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Refreshing instance network info cache due to event network-changed-473a9253-5ee7-4ef1-bd1a-f260bc80b158. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] Acquiring lock "refresh_cache-1d0bc5da-ed98-417a-9fc1-1f636887f035" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:09:30 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Creating image(s)
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.network.neutron [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.258s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.204s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.097s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk 1073741824" returned: 0 in 0.094s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:09:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.185s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.network.neutron [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Updating instance_info_cache with network_info: [{"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.policy [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ac61f1cb87d4ed5a488b2cff4a63375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5768be2d4a446f4ac473502a0b909dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:09:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Creating image(s)
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "/opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "/opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "/opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "5d8e5d0f030415416aa1d4b321dced2a79807b8a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "5d8e5d0f030415416aa1d4b321dced2a79807b8a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Releasing lock "refresh_cache-1d0bc5da-ed98-417a-9fc1-1f636887f035" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Instance network_info: |[{"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] Acquired lock "refresh_cache-1d0bc5da-ed98-417a-9fc1-1f636887f035" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.network.neutron [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Refreshing network info cache for port 473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Start _get_guest_xml network_info=[{"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Cannot resize image /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:09:31 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'migration_context' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Ensure instance console log exists: /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:32 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:32 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-918812097',display_name='tempest-VolumesAdminNegativeTest-server-918812097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-918812097',id=8,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuIgyZwMNd/jS/ptwUJ9c7NTZM1n41EYebpoe+m79K324B9wtg2doS6hIGg4lStBCzYi9hRmMjrSFhFxaPWDaPglTQ7D/AzXNQhJudprzbZalCEvYmeCtPngO6pepEMaQ==',key_name='tempest-keypair-521589223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd9e7d6ece244a96b01277451a3ed5a5',ramdisk_id='',reservation_id='r-js06k03k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-588655718',owner_user_name='tempest-VolumesAdminNegativeTest-588655718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8911ec7c959541989cce3870ba11fb80',uuid=1d0bc5da-ed98-417a-9fc1-1f636887f035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converting VIF {"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:30:3c,bridge_name='br-int',has_traffic_filtering=True,id=473a9253-5ee7-4ef1-bd1a-f260bc80b158,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473a9253-5e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.objects.instance [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d0bc5da-ed98-417a-9fc1-1f636887f035 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:09:32 user nova-compute[71482]:   <uuid>1d0bc5da-ed98-417a-9fc1-1f636887f035</uuid>
Apr 12 09:09:32 user nova-compute[71482]:   <name>instance-00000008</name>
Apr 12 09:09:32 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:09:32 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:09:32 user nova-compute[71482]:   <metadata>
Apr 12 09:09:32 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:09:32 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:09:32 user nova-compute[71482]:       <nova:name>tempest-VolumesAdminNegativeTest-server-918812097</nova:name>
Apr 12 09:09:32 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:09:32</nova:creationTime>
Apr 12 09:09:32 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:09:32 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:09:32 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:09:32 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:09:32 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:09:32 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:09:32 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:09:32 user nova-compute[71482]:       <nova:owner>
Apr 12 09:09:32 user nova-compute[71482]:         <nova:user uuid="8911ec7c959541989cce3870ba11fb80">tempest-VolumesAdminNegativeTest-588655718-project-member</nova:user>
Apr 12 09:09:32 user nova-compute[71482]:         <nova:project uuid="dd9e7d6ece244a96b01277451a3ed5a5">tempest-VolumesAdminNegativeTest-588655718</nova:project>
Apr 12 09:09:32 user nova-compute[71482]:       </nova:owner>
Apr 12 09:09:32 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:09:32 user nova-compute[71482]:       <nova:ports>
Apr 12 09:09:32 user nova-compute[71482]:         <nova:port uuid="473a9253-5ee7-4ef1-bd1a-f260bc80b158">
Apr 12 09:09:32 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 09:09:32 user nova-compute[71482]:         </nova:port>
Apr 12 09:09:32 user nova-compute[71482]:       </nova:ports>
Apr 12 09:09:32 user nova-compute[71482]:     </nova:instance>
Apr 12 09:09:32 user nova-compute[71482]:   </metadata>
Apr 12 09:09:32 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:09:32 user nova-compute[71482]:     <system>
Apr 12 09:09:32 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:09:32 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:09:32 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:09:32 user nova-compute[71482]:       <entry name="serial">1d0bc5da-ed98-417a-9fc1-1f636887f035</entry>
Apr 12 09:09:32 user nova-compute[71482]:       <entry name="uuid">1d0bc5da-ed98-417a-9fc1-1f636887f035</entry>
Apr 12 09:09:32 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:09:32 user nova-compute[71482]:     </system>
Apr 12 09:09:32 user nova-compute[71482]:   </sysinfo>
Apr 12 09:09:32 user nova-compute[71482]:   <os>
Apr 12 09:09:32 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:09:32 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:09:32 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:09:32 user nova-compute[71482]:   </os>
Apr 12 09:09:32 user nova-compute[71482]:   <features>
Apr 12 09:09:32 user nova-compute[71482]:     <acpi/>
Apr 12 09:09:32 user nova-compute[71482]:     <apic/>
Apr 12 09:09:32 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:09:32 user nova-compute[71482]:   </features>
Apr 12 09:09:32 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:09:32 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:09:32 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:09:32 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:09:32 user nova-compute[71482]:   </clock>
Apr 12 09:09:32 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:09:32 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:09:32 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:09:32 user nova-compute[71482]:   </cpu>
Apr 12 09:09:32 user nova-compute[71482]:   <devices>
Apr 12 09:09:32 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:09:32 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:09:32 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk"/>
Apr 12 09:09:32 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:09:32 user nova-compute[71482]:     </disk>
Apr 12 09:09:32 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:09:32 user nova-compute[71482]:       <mac address="fa:16:3e:b0:30:3c"/>
Apr 12 09:09:32 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:32 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:09:32 user nova-compute[71482]:       <target dev="tap473a9253-5e"/>
Apr 12 09:09:32 user nova-compute[71482]:     </interface>
Apr 12 09:09:32 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:09:32 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/console.log" append="off"/>
Apr 12 09:09:32 user nova-compute[71482]:     </serial>
Apr 12 09:09:32 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:09:32 user nova-compute[71482]:     <video>
Apr 12 09:09:32 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:32 user nova-compute[71482]:     </video>
Apr 12 09:09:32 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:09:32 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:09:32 user nova-compute[71482]:     </rng>
Apr 12 09:09:32 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:09:32 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:09:32 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:09:32 user nova-compute[71482]:     </memballoon>
Apr 12 09:09:32 user nova-compute[71482]:   </devices>
Apr 12 09:09:32 user nova-compute[71482]: </domain>
Apr 12 09:09:32 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-918812097',display_name='tempest-VolumesAdminNegativeTest-server-918812097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-918812097',id=8,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuIgyZwMNd/jS/ptwUJ9c7NTZM1n41EYebpoe+m79K324B9wtg2doS6hIGg4lStBCzYi9hRmMjrSFhFxaPWDaPglTQ7D/AzXNQhJudprzbZalCEvYmeCtPngO6pepEMaQ==',key_name='tempest-keypair-521589223',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd9e7d6ece244a96b01277451a3ed5a5',ramdisk_id='',reservation_id='r-js06k03k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-588655718',owner_user_name='tempest-VolumesAdminNegativeTest-588655718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8911ec7c959541989cce3870ba11fb80',uuid=1d0bc5da-ed98-417a-9fc1-1f636887f035,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converting VIF {"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:30:3c,bridge_name='br-int',has_traffic_filtering=True,id=473a9253-5ee7-4ef1-bd1a-f260bc80b158,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473a9253-5e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG os_vif [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:30:3c,bridge_name='br-int',has_traffic_filtering=True,id=473a9253-5ee7-4ef1-bd1a-f260bc80b158,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473a9253-5e') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap473a9253-5e, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap473a9253-5e, col_values=(('external_ids', {'iface-id': '473a9253-5ee7-4ef1-bd1a-f260bc80b158', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:30:3c', 'vm-uuid': '1d0bc5da-ed98-417a-9fc1-1f636887f035'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:32 user nova-compute[71482]: INFO os_vif [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:30:3c,bridge_name='br-int',has_traffic_filtering=True,id=473a9253-5ee7-4ef1-bd1a-f260bc80b158,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473a9253-5e')
Apr 12 09:09:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] No VIF found with MAC fa:16:3e:b0:30:3c, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a.part --force-share --output=json" returned: 0 in 0.210s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.virt.images [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] bcda072a-5430-47b7-b2b3-b29e054883ad was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a.part /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Successfully created port: c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a.part /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a.converted" returned: 0 in 0.240s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a.converted --force-share --output=json" returned: 0 in 0.205s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "5d8e5d0f030415416aa1d4b321dced2a79807b8a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.255s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a --force-share --output=json" returned: 0 in 0.177s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "5d8e5d0f030415416aa1d4b321dced2a79807b8a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "5d8e5d0f030415416aa1d4b321dced2a79807b8a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a --force-share --output=json" returned: 0 in 0.195s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a,backing_fmt=raw /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a,backing_fmt=raw /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk 1073741824" returned: 0 in 0.079s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "5d8e5d0f030415416aa1d4b321dced2a79807b8a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a --force-share --output=json" returned: 0 in 0.208s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:09:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG nova.network.neutron [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Updated VIF entry in instance network info cache for port 473a9253-5ee7-4ef1-bd1a-f260bc80b158. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG nova.network.neutron [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Updating instance_info_cache with network_info: [{"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-90abb61c-95fd-4d6a-ad59-fb68875f0359 req-3cbeb837-8aba-456c-a391-4551a17a38fb service nova] Releasing lock "refresh_cache-1d0bc5da-ed98-417a-9fc1-1f636887f035" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Cannot resize image /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG nova.objects.instance [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lazy-loading 'migration_context' on Instance uuid 22eabe74-0932-472e-8090-09e8431f4f4a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Ensure instance console log exists: /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Successfully created port: f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:09:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received event network-vif-plugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] No waiting events found dispatching network-vif-plugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:35 user nova-compute[71482]: WARNING nova.compute.manager [req-6425653b-f00a-4ced-be73-048840a2fb2a req-2ce2dc05-3f97-466a-9b1c-2ce0b38a4c15 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received unexpected event network-vif-plugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance with vm_state building and task_state spawning.
Apr 12 09:09:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Successfully updated port: c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquired lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:09:35 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating instance_info_cache with network_info: [{"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Releasing lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Instance network_info: |[{"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Start _get_guest_xml network_info=[{"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:09:36 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:36 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091699595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2091699595',id=9,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ==',key_name='tempest-keypair-591560650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed443186516c4075ab14a4b0be130e31',ramdisk_id='',reservation_id='r-zd9zb9ej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1337552011',owner_user_name='tempest-TaggedAttachmentsTest-1337552011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc97c54107de479bade4014982d79287',uuid=fbbb84fb-1d35-4249-8c8a-d9a02176243c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converting VIF {"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0e:e4,bridge_name='br-int',has_traffic_filtering=True,id=c7ccda6d-74db-4747-a5eb-dba5e82506fa,network=Network(00c625ad-e5a3-4c0d-b3d2-7b78e9385843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ccda6d-74') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'pci_devices' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Successfully updated port: f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:09:36 user nova-compute[71482]:   <uuid>fbbb84fb-1d35-4249-8c8a-d9a02176243c</uuid>
Apr 12 09:09:36 user nova-compute[71482]:   <name>instance-00000009</name>
Apr 12 09:09:36 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:09:36 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:09:36 user nova-compute[71482]:   <metadata>
Apr 12 09:09:36 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:09:36 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:09:36 user nova-compute[71482]:       <nova:name>tempest-device-tagging-server-2091699595</nova:name>
Apr 12 09:09:36 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:09:36</nova:creationTime>
Apr 12 09:09:36 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:09:36 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:09:36 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:09:36 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:09:36 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:09:36 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:09:36 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:09:36 user nova-compute[71482]:       <nova:owner>
Apr 12 09:09:36 user nova-compute[71482]:         <nova:user uuid="bc97c54107de479bade4014982d79287">tempest-TaggedAttachmentsTest-1337552011-project-member</nova:user>
Apr 12 09:09:36 user nova-compute[71482]:         <nova:project uuid="ed443186516c4075ab14a4b0be130e31">tempest-TaggedAttachmentsTest-1337552011</nova:project>
Apr 12 09:09:36 user nova-compute[71482]:       </nova:owner>
Apr 12 09:09:36 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:09:36 user nova-compute[71482]:       <nova:ports>
Apr 12 09:09:36 user nova-compute[71482]:         <nova:port uuid="c7ccda6d-74db-4747-a5eb-dba5e82506fa">
Apr 12 09:09:36 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:09:36 user nova-compute[71482]:         </nova:port>
Apr 12 09:09:36 user nova-compute[71482]:       </nova:ports>
Apr 12 09:09:36 user nova-compute[71482]:     </nova:instance>
Apr 12 09:09:36 user nova-compute[71482]:   </metadata>
Apr 12 09:09:36 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:09:36 user nova-compute[71482]:     <system>
Apr 12 09:09:36 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:09:36 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:09:36 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:09:36 user nova-compute[71482]:       <entry name="serial">fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:09:36 user nova-compute[71482]:       <entry name="uuid">fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:09:36 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:09:36 user nova-compute[71482]:     </system>
Apr 12 09:09:36 user nova-compute[71482]:   </sysinfo>
Apr 12 09:09:36 user nova-compute[71482]:   <os>
Apr 12 09:09:36 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:09:36 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:09:36 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:09:36 user nova-compute[71482]:   </os>
Apr 12 09:09:36 user nova-compute[71482]:   <features>
Apr 12 09:09:36 user nova-compute[71482]:     <acpi/>
Apr 12 09:09:36 user nova-compute[71482]:     <apic/>
Apr 12 09:09:36 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:09:36 user nova-compute[71482]:   </features>
Apr 12 09:09:36 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:09:36 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:09:36 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:09:36 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:09:36 user nova-compute[71482]:   </clock>
Apr 12 09:09:36 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:09:36 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:09:36 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:09:36 user nova-compute[71482]:   </cpu>
Apr 12 09:09:36 user nova-compute[71482]:   <devices>
Apr 12 09:09:36 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:09:36 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:09:36 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk"/>
Apr 12 09:09:36 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:09:36 user nova-compute[71482]:     </disk>
Apr 12 09:09:36 user nova-compute[71482]:     <disk type="file" device="cdrom">
Apr 12 09:09:36 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 09:09:36 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.config"/>
Apr 12 09:09:36 user nova-compute[71482]:       <target dev="hda" bus="ide"/>
Apr 12 09:09:36 user nova-compute[71482]:     </disk>
Apr 12 09:09:36 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:09:36 user nova-compute[71482]:       <mac address="fa:16:3e:3d:0e:e4"/>
Apr 12 09:09:36 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:36 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:09:36 user nova-compute[71482]:       <target dev="tapc7ccda6d-74"/>
Apr 12 09:09:36 user nova-compute[71482]:     </interface>
Apr 12 09:09:36 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:09:36 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log" append="off"/>
Apr 12 09:09:36 user nova-compute[71482]:     </serial>
Apr 12 09:09:36 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:09:36 user nova-compute[71482]:     <video>
Apr 12 09:09:36 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:36 user nova-compute[71482]:     </video>
Apr 12 09:09:36 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:09:36 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:09:36 user nova-compute[71482]:     </rng>
Apr 12 09:09:36 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:09:36 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:09:36 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:09:36 user nova-compute[71482]:     </memballoon>
Apr 12 09:09:36 user nova-compute[71482]:   </devices>
Apr 12 09:09:36 user nova-compute[71482]: </domain>
Apr 12 09:09:36 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091699595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2091699595',id=9,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ==',key_name='tempest-keypair-591560650',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed443186516c4075ab14a4b0be130e31',ramdisk_id='',reservation_id='r-zd9zb9ej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1337552011',owner_user_name='tempest-TaggedAttachmentsTest-1337552011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc97c54107de479bade4014982d79287',uuid=fbbb84fb-1d35-4249-8c8a-d9a02176243c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converting VIF {"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0e:e4,bridge_name='br-int',has_traffic_filtering=True,id=c7ccda6d-74db-4747-a5eb-dba5e82506fa,network=Network(00c625ad-e5a3-4c0d-b3d2-7b78e9385843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ccda6d-74') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG os_vif [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0e:e4,bridge_name='br-int',has_traffic_filtering=True,id=c7ccda6d-74db-4747-a5eb-dba5e82506fa,network=Network(00c625ad-e5a3-4c0d-b3d2-7b78e9385843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ccda6d-74') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "refresh_cache-22eabe74-0932-472e-8090-09e8431f4f4a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquired lock "refresh_cache-22eabe74-0932-472e-8090-09e8431f4f4a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7ccda6d-74, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc7ccda6d-74, col_values=(('external_ids', {'iface-id': 'c7ccda6d-74db-4747-a5eb-dba5e82506fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:0e:e4', 'vm-uuid': 'fbbb84fb-1d35-4249-8c8a-d9a02176243c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:36 user nova-compute[71482]: INFO os_vif [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:0e:e4,bridge_name='br-int',has_traffic_filtering=True,id=c7ccda6d-74db-4747-a5eb-dba5e82506fa,network=Network(00c625ad-e5a3-4c0d-b3d2-7b78e9385843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ccda6d-74')
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received event network-changed-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Refreshing instance network info cache due to event network-changed-f3af3839-bbd2-4152-ab34-91c767220af4. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] Acquiring lock "refresh_cache-22eabe74-0932-472e-8090-09e8431f4f4a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] No BDM found with device name hda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] No VIF found with MAC fa:16:3e:3d:0e:e4, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:09:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Using config drive
Apr 12 09:09:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:36 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Creating config drive at /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.config
Apr 12 09:09:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr21mbcpz {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpr21mbcpz" returned: 0 in 0.079s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-changed-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Refreshing instance network info cache due to event network-changed-c7ccda6d-74db-4747-a5eb-dba5e82506fa. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Acquiring lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Acquired lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.network.neutron [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Refreshing network info cache for port c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Updating instance_info_cache with network_info: [{"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Releasing lock "refresh_cache-22eabe74-0932-472e-8090-09e8431f4f4a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Instance network_info: |[{"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] Acquired lock "refresh_cache-22eabe74-0932-472e-8090-09e8431f4f4a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.network.neutron [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Refreshing network info cache for port f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Start _get_guest_xml network_info=[{"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:09:16Z,direct_url=<?>,disk_format='qcow2',id=bcda072a-5430-47b7-b2b3-b29e054883ad,min_disk=0,min_ram=0,name='',owner='1759b8ff0e7741daa4fe99afb467c53d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:09:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/sda', 'encryption_format': None, 'disk_bus': 'scsi', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'bcda072a-5430-47b7-b2b3-b29e054883ad'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:09:37 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:37 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:09:16Z,direct_url=<?>,disk_format='qcow2',id=bcda072a-5430-47b7-b2b3-b29e054883ad,min_disk=0,min_ram=0,name='',owner='1759b8ff0e7741daa4fe99afb467c53d',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:09:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1504382156',display_name='tempest-AttachSCSIVolumeTestJSON-server-1504382156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1504382156',id=10,image_ref='bcda072a-5430-47b7-b2b3-b29e054883ad',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhIEvy6u0ucraKFLAKUfRFmPWc1THTzkE+nKz5trKmDMVoQY5PQec7o8K/gFwTTmFODGDbFv4P9xU/YGnuWeTKYMN0cg2aCVtGTel1KJX/H1uLY/x5ICkLJGSItgbH6bQ==',key_name='tempest-keypair-1729758921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5768be2d4a446f4ac473502a0b909dc',ramdisk_id='',reservation_id='r-m58u8dj0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcda072a-5430-47b7-b2b3-b29e054883ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-580617659',owner_user_name='tempest-AttachSCSIVolumeTestJSON-580617659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac61f1cb87d4ed5a488b2cff4a63375',uuid=22eabe74-0932-472e-8090-09e8431f4f4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Converting VIF {"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:22:e5,bridge_name='br-int',has_traffic_filtering=True,id=f3af3839-bbd2-4152-ab34-91c767220af4,network=Network(de15a39b-b186-4f7a-a0e1-40e8dad38f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af3839-bb') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lazy-loading 'pci_devices' on Instance uuid 22eabe74-0932-472e-8090-09e8431f4f4a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:09:37 user nova-compute[71482]:   <uuid>22eabe74-0932-472e-8090-09e8431f4f4a</uuid>
Apr 12 09:09:37 user nova-compute[71482]:   <name>instance-0000000a</name>
Apr 12 09:09:37 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:09:37 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:09:37 user nova-compute[71482]:   <metadata>
Apr 12 09:09:37 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:09:37 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:09:37 user nova-compute[71482]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1504382156</nova:name>
Apr 12 09:09:37 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:09:37</nova:creationTime>
Apr 12 09:09:37 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:09:37 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:09:37 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:09:37 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:09:37 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:09:37 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:09:37 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:09:37 user nova-compute[71482]:       <nova:owner>
Apr 12 09:09:37 user nova-compute[71482]:         <nova:user uuid="8ac61f1cb87d4ed5a488b2cff4a63375">tempest-AttachSCSIVolumeTestJSON-580617659-project-member</nova:user>
Apr 12 09:09:37 user nova-compute[71482]:         <nova:project uuid="c5768be2d4a446f4ac473502a0b909dc">tempest-AttachSCSIVolumeTestJSON-580617659</nova:project>
Apr 12 09:09:37 user nova-compute[71482]:       </nova:owner>
Apr 12 09:09:37 user nova-compute[71482]:       <nova:root type="image" uuid="bcda072a-5430-47b7-b2b3-b29e054883ad"/>
Apr 12 09:09:37 user nova-compute[71482]:       <nova:ports>
Apr 12 09:09:37 user nova-compute[71482]:         <nova:port uuid="f3af3839-bbd2-4152-ab34-91c767220af4">
Apr 12 09:09:37 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 09:09:37 user nova-compute[71482]:         </nova:port>
Apr 12 09:09:37 user nova-compute[71482]:       </nova:ports>
Apr 12 09:09:37 user nova-compute[71482]:     </nova:instance>
Apr 12 09:09:37 user nova-compute[71482]:   </metadata>
Apr 12 09:09:37 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:09:37 user nova-compute[71482]:     <system>
Apr 12 09:09:37 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:09:37 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:09:37 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:09:37 user nova-compute[71482]:       <entry name="serial">22eabe74-0932-472e-8090-09e8431f4f4a</entry>
Apr 12 09:09:37 user nova-compute[71482]:       <entry name="uuid">22eabe74-0932-472e-8090-09e8431f4f4a</entry>
Apr 12 09:09:37 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:09:37 user nova-compute[71482]:     </system>
Apr 12 09:09:37 user nova-compute[71482]:   </sysinfo>
Apr 12 09:09:37 user nova-compute[71482]:   <os>
Apr 12 09:09:37 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:09:37 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:09:37 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:09:37 user nova-compute[71482]:   </os>
Apr 12 09:09:37 user nova-compute[71482]:   <features>
Apr 12 09:09:37 user nova-compute[71482]:     <acpi/>
Apr 12 09:09:37 user nova-compute[71482]:     <apic/>
Apr 12 09:09:37 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:09:37 user nova-compute[71482]:   </features>
Apr 12 09:09:37 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:09:37 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:09:37 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:09:37 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:09:37 user nova-compute[71482]:   </clock>
Apr 12 09:09:37 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:09:37 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:09:37 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:09:37 user nova-compute[71482]:   </cpu>
Apr 12 09:09:37 user nova-compute[71482]:   <devices>
Apr 12 09:09:37 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:09:37 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:09:37 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk"/>
Apr 12 09:09:37 user nova-compute[71482]:       <target dev="sda" bus="scsi"/>
Apr 12 09:09:37 user nova-compute[71482]:       <address type="drive" controller="0" unit="0"/>
Apr 12 09:09:37 user nova-compute[71482]:     </disk>
Apr 12 09:09:37 user nova-compute[71482]:     <disk type="file" device="cdrom">
Apr 12 09:09:37 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 09:09:37 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk.config"/>
Apr 12 09:09:37 user nova-compute[71482]:       <target dev="sdb" bus="scsi"/>
Apr 12 09:09:37 user nova-compute[71482]:       <address type="drive" controller="0" unit="1"/>
Apr 12 09:09:37 user nova-compute[71482]:     </disk>
Apr 12 09:09:37 user nova-compute[71482]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 12 09:09:37 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:09:37 user nova-compute[71482]:       <mac address="fa:16:3e:34:22:e5"/>
Apr 12 09:09:37 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:37 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:09:37 user nova-compute[71482]:       <target dev="tapf3af3839-bb"/>
Apr 12 09:09:37 user nova-compute[71482]:     </interface>
Apr 12 09:09:37 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:09:37 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/console.log" append="off"/>
Apr 12 09:09:37 user nova-compute[71482]:     </serial>
Apr 12 09:09:37 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:09:37 user nova-compute[71482]:     <video>
Apr 12 09:09:37 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:37 user nova-compute[71482]:     </video>
Apr 12 09:09:37 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:09:37 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:09:37 user nova-compute[71482]:     </rng>
Apr 12 09:09:37 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:09:37 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:09:37 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:09:37 user nova-compute[71482]:     </memballoon>
Apr 12 09:09:37 user nova-compute[71482]:   </devices>
Apr 12 09:09:37 user nova-compute[71482]: </domain>
Apr 12 09:09:37 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1504382156',display_name='tempest-AttachSCSIVolumeTestJSON-server-1504382156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1504382156',id=10,image_ref='bcda072a-5430-47b7-b2b3-b29e054883ad',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhIEvy6u0ucraKFLAKUfRFmPWc1THTzkE+nKz5trKmDMVoQY5PQec7o8K/gFwTTmFODGDbFv4P9xU/YGnuWeTKYMN0cg2aCVtGTel1KJX/H1uLY/x5ICkLJGSItgbH6bQ==',key_name='tempest-keypair-1729758921',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c5768be2d4a446f4ac473502a0b909dc',ramdisk_id='',reservation_id='r-m58u8dj0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcda072a-5430-47b7-b2b3-b29e054883ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-580617659',owner_user_name='tempest-AttachSCSIVolumeTestJSON-580617659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac61f1cb87d4ed5a488b2cff4a63375',uuid=22eabe74-0932-472e-8090-09e8431f4f4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Converting VIF {"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:22:e5,bridge_name='br-int',has_traffic_filtering=True,id=f3af3839-bbd2-4152-ab34-91c767220af4,network=Network(de15a39b-b186-4f7a-a0e1-40e8dad38f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af3839-bb') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG os_vif [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:22:e5,bridge_name='br-int',has_traffic_filtering=True,id=f3af3839-bbd2-4152-ab34-91c767220af4,network=Network(de15a39b-b186-4f7a-a0e1-40e8dad38f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af3839-bb') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3af3839-bb, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3af3839-bb, col_values=(('external_ids', {'iface-id': 'f3af3839-bbd2-4152-ab34-91c767220af4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:22:e5', 'vm-uuid': '22eabe74-0932-472e-8090-09e8431f4f4a'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:37 user nova-compute[71482]: INFO os_vif [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:22:e5,bridge_name='br-int',has_traffic_filtering=True,id=f3af3839-bbd2-4152-ab34-91c767220af4,network=Network(de15a39b-b186-4f7a-a0e1-40e8dad38f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af3839-bb')
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290577.9605742, 1d0bc5da-ed98-417a-9fc1-1f636887f035 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:37 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] VM Resumed (Lifecycle Event)
Apr 12 09:09:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Instance spawned successfully.
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] No BDM found with device name sda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] No VIF found with MAC fa:16:3e:34:22:e5, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:09:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Using config drive
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:09:38 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290577.965254, 1d0bc5da-ed98-417a-9fc1-1f636887f035 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:38 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] VM Started (Lifecycle Event)
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:38 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:38 user nova-compute[71482]: INFO nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Took 14.06 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.network.neutron [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updated VIF entry in instance network info cache for port c7ccda6d-74db-4747-a5eb-dba5e82506fa. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.network.neutron [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating instance_info_cache with network_info: [{"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Releasing lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received event network-vif-plugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] No waiting events found dispatching network-vif-plugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:38 user nova-compute[71482]: WARNING nova.compute.manager [req-74b77cdf-8c1a-4433-8f36-b8c1951e686b req-ce77778a-a0cb-4a18-bf01-901035641e88 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received unexpected event network-vif-plugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance with vm_state building and task_state spawning.
Apr 12 09:09:38 user nova-compute[71482]: INFO nova.compute.manager [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Took 15.68 seconds to build instance.
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-53cff92b-ff17-4e20-bebf-4525a4f6e99f tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.848s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Creating config drive at /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk.config
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpras4yr2r {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpras4yr2r" returned: 0 in 0.059s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.network.neutron [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Updated VIF entry in instance network info cache for port f3af3839-bbd2-4152-ab34-91c767220af4. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG nova.network.neutron [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Updating instance_info_cache with network_info: [{"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5d7a08ca-91f9-4928-a6df-8fc37039b5d9 req-870e5397-6128-4dd0-a13b-1a4c151fe485 service nova] Releasing lock "refresh_cache-22eabe74-0932-472e-8090-09e8431f4f4a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-plugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] No waiting events found dispatching network-vif-plugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:39 user nova-compute[71482]: WARNING nova.compute.manager [req-f68e9c82-63c6-4115-835e-0b49445d6c6c req-9d88721d-79f0-4e52-8443-4195429b0152 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received unexpected event network-vif-plugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance with vm_state building and task_state spawning.
Apr 12 09:09:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Skipping network cache update for instance because it is Building. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Skipping network cache update for instance because it is Building. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid a569c652-6b15-4244-b011-1d09fbdd4281 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received event network-vif-plugged-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] No waiting events found dispatching network-vif-plugged-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:40 user nova-compute[71482]: WARNING nova.compute.manager [req-6f390cd7-7005-4443-a50d-8b25336b203c req-58c584f0-c3b0-4e92-8081-c15306589028 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received unexpected event network-vif-plugged-f3af3839-bbd2-4152-ab34-91c767220af4 for instance with vm_state building and task_state spawning.
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updating instance_info_cache with network_info: [{"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:09:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-plugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] No waiting events found dispatching network-vif-plugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:41 user nova-compute[71482]: WARNING nova.compute.manager [req-13ee8cd4-4d5d-48c5-86d0-ed1ccbf29819 req-5f5a5623-5372-42f4-b638-a17dc35fba0b service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received unexpected event network-vif-plugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance with vm_state building and task_state spawning.
Apr 12 09:09:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290582.6719668, fbbb84fb-1d35-4249-8c8a-d9a02176243c => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:42 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] VM Resumed (Lifecycle Event)
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:42 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Instance spawned successfully.
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:42 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290582.673219, fbbb84fb-1d35-4249-8c8a-d9a02176243c => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:42 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] VM Started (Lifecycle Event)
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:42 user nova-compute[71482]: INFO nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Took 11.91 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:42 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received event network-vif-plugged-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] No waiting events found dispatching network-vif-plugged-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:42 user nova-compute[71482]: WARNING nova.compute.manager [req-749bfa30-ff1a-49b2-90d0-4d166203bb5b req-524bb88a-c9e5-435e-a294-6921e22e12f3 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received unexpected event network-vif-plugged-f3af3839-bbd2-4152-ab34-91c767220af4 for instance with vm_state building and task_state spawning.
Apr 12 09:09:42 user nova-compute[71482]: INFO nova.compute.manager [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Took 13.29 seconds to build instance.
Apr 12 09:09:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3494a395-d036-401f-a568-fb1aff232e8d tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.522s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290583.1327107, 22eabe74-0932-472e-8090-09e8431f4f4a => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] VM Resumed (Lifecycle Event)
Apr 12 09:09:43 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Instance spawned successfully.
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290583.1328485, 22eabe74-0932-472e-8090-09e8431f4f4a => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] VM Started (Lifecycle Event)
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:43 user nova-compute[71482]: INFO nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Took 11.43 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:09:43 user nova-compute[71482]: INFO nova.compute.manager [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Took 13.20 seconds to build instance.
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4a59e605-285c-426b-9e6a-37730d2efa0a tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.426s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:09:43 user nova-compute[71482]: INFO nova.compute.claims [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Claim successful on node user
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.804s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:09:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:09:44 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG nova.policy [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:09:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Creating image(s)
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "/opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "/opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "/opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.173s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.157s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk 1073741824" returned: 0 in 0.058s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Cannot resize image /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG nova.objects.instance [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'migration_context' on Instance uuid a5e42339-50fa-411c-94a1-c350727b7955 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Ensure instance console log exists: /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Successfully created port: 60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Successfully updated port: 60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquired lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received event network-changed-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Refreshing instance network info cache due to event network-changed-60f2af8d-b456-4efe-b146-cc700b68733e. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] Acquiring lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updating instance_info_cache with network_info: [{"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:47 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:47 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7642MB free_disk=26.657726287841797GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Releasing lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Instance network_info: |[{"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] Acquired lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.network.neutron [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Refreshing network info cache for port 60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Start _get_guest_xml network_info=[{"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:09:47 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:47 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-33778613',display_name='tempest-TestStampPattern-server-33778613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-33778613',id=11,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+fsSS3XTWnvMjjcXo2M/eSLvS9TQwtC5Vw9sxk2wzTZ75i0he3Eo6b0vT0HPmDlWDm3m80IrirjqBjUz0Z8GQDLK2hw+EpHpQKcspVFgKhBnSTs/WZpB6phNQXZtwf0w==',key_name='tempest-TestStampPattern-1475014031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81d39dd859ed4684a659c79ca3ea3fb4',ramdisk_id='',reservation_id='r-bbio33zr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1126496829',owner_user_name='tempest-TestStampPattern-1126496829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:45Z,user_data=None,user_id='e0440debc9af46e690788752e32f0912',uuid=a5e42339-50fa-411c-94a1-c350727b7955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converting VIF {"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=60f2af8d-b456-4efe-b146-cc700b68733e,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2af8d-b4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.objects.instance [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'pci_devices' on Instance uuid a5e42339-50fa-411c-94a1-c350727b7955 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:09:47 user nova-compute[71482]:   <uuid>a5e42339-50fa-411c-94a1-c350727b7955</uuid>
Apr 12 09:09:47 user nova-compute[71482]:   <name>instance-0000000b</name>
Apr 12 09:09:47 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:09:47 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:09:47 user nova-compute[71482]:   <metadata>
Apr 12 09:09:47 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:09:47 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:09:47 user nova-compute[71482]:       <nova:name>tempest-TestStampPattern-server-33778613</nova:name>
Apr 12 09:09:47 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:09:47</nova:creationTime>
Apr 12 09:09:47 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:09:47 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:09:47 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:09:47 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:09:47 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:09:47 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:09:47 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:09:47 user nova-compute[71482]:       <nova:owner>
Apr 12 09:09:47 user nova-compute[71482]:         <nova:user uuid="e0440debc9af46e690788752e32f0912">tempest-TestStampPattern-1126496829-project-member</nova:user>
Apr 12 09:09:47 user nova-compute[71482]:         <nova:project uuid="81d39dd859ed4684a659c79ca3ea3fb4">tempest-TestStampPattern-1126496829</nova:project>
Apr 12 09:09:47 user nova-compute[71482]:       </nova:owner>
Apr 12 09:09:47 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:09:47 user nova-compute[71482]:       <nova:ports>
Apr 12 09:09:47 user nova-compute[71482]:         <nova:port uuid="60f2af8d-b456-4efe-b146-cc700b68733e">
Apr 12 09:09:47 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:09:47 user nova-compute[71482]:         </nova:port>
Apr 12 09:09:47 user nova-compute[71482]:       </nova:ports>
Apr 12 09:09:47 user nova-compute[71482]:     </nova:instance>
Apr 12 09:09:47 user nova-compute[71482]:   </metadata>
Apr 12 09:09:47 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:09:47 user nova-compute[71482]:     <system>
Apr 12 09:09:47 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:09:47 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:09:47 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:09:47 user nova-compute[71482]:       <entry name="serial">a5e42339-50fa-411c-94a1-c350727b7955</entry>
Apr 12 09:09:47 user nova-compute[71482]:       <entry name="uuid">a5e42339-50fa-411c-94a1-c350727b7955</entry>
Apr 12 09:09:47 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:09:47 user nova-compute[71482]:     </system>
Apr 12 09:09:47 user nova-compute[71482]:   </sysinfo>
Apr 12 09:09:47 user nova-compute[71482]:   <os>
Apr 12 09:09:47 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:09:47 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:09:47 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:09:47 user nova-compute[71482]:   </os>
Apr 12 09:09:47 user nova-compute[71482]:   <features>
Apr 12 09:09:47 user nova-compute[71482]:     <acpi/>
Apr 12 09:09:47 user nova-compute[71482]:     <apic/>
Apr 12 09:09:47 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:09:47 user nova-compute[71482]:   </features>
Apr 12 09:09:47 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:09:47 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:09:47 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:09:47 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:09:47 user nova-compute[71482]:   </clock>
Apr 12 09:09:47 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:09:47 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:09:47 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:09:47 user nova-compute[71482]:   </cpu>
Apr 12 09:09:47 user nova-compute[71482]:   <devices>
Apr 12 09:09:47 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:09:47 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:09:47 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk"/>
Apr 12 09:09:47 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:09:47 user nova-compute[71482]:     </disk>
Apr 12 09:09:47 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:09:47 user nova-compute[71482]:       <mac address="fa:16:3e:d0:b5:14"/>
Apr 12 09:09:47 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:47 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:09:47 user nova-compute[71482]:       <target dev="tap60f2af8d-b4"/>
Apr 12 09:09:47 user nova-compute[71482]:     </interface>
Apr 12 09:09:47 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:09:47 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/console.log" append="off"/>
Apr 12 09:09:47 user nova-compute[71482]:     </serial>
Apr 12 09:09:47 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:09:47 user nova-compute[71482]:     <video>
Apr 12 09:09:47 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:09:47 user nova-compute[71482]:     </video>
Apr 12 09:09:47 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:09:47 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:09:47 user nova-compute[71482]:     </rng>
Apr 12 09:09:47 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:09:47 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:09:47 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:09:47 user nova-compute[71482]:     </memballoon>
Apr 12 09:09:47 user nova-compute[71482]:   </devices>
Apr 12 09:09:47 user nova-compute[71482]: </domain>
Apr 12 09:09:47 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-33778613',display_name='tempest-TestStampPattern-server-33778613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-33778613',id=11,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+fsSS3XTWnvMjjcXo2M/eSLvS9TQwtC5Vw9sxk2wzTZ75i0he3Eo6b0vT0HPmDlWDm3m80IrirjqBjUz0Z8GQDLK2hw+EpHpQKcspVFgKhBnSTs/WZpB6phNQXZtwf0w==',key_name='tempest-TestStampPattern-1475014031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81d39dd859ed4684a659c79ca3ea3fb4',ramdisk_id='',reservation_id='r-bbio33zr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1126496829',owner_user_name='tempest-TestStampPattern-1126496829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:45Z,user_data=None,user_id='e0440debc9af46e690788752e32f0912',uuid=a5e42339-50fa-411c-94a1-c350727b7955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converting VIF {"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=60f2af8d-b456-4efe-b146-cc700b68733e,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2af8d-b4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG os_vif [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=60f2af8d-b456-4efe-b146-cc700b68733e,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2af8d-b4') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f2af8d-b4, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60f2af8d-b4, col_values=(('external_ids', {'iface-id': '60f2af8d-b456-4efe-b146-cc700b68733e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:b5:14', 'vm-uuid': 'a5e42339-50fa-411c-94a1-c350727b7955'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:47 user nova-compute[71482]: INFO os_vif [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=60f2af8d-b456-4efe-b146-cc700b68733e,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2af8d-b4')
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:09:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No VIF found with MAC fa:16:3e:d0:b5:14, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f683bc12-8fca-47de-b28e-a0070e77b387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 94f40323-58a6-4e9c-b26b-23615dde13d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a5e42339-50fa-411c-94a1-c350727b7955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 22eabe74-0932-472e-8090-09e8431f4f4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updated VIF entry in instance network info cache for port 60f2af8d-b456-4efe-b146-cc700b68733e. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updating instance_info_cache with network_info: [{"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fe0e8be0-a29f-4451-9ece-28df8803279e req-a3740cbf-8131-4fa2-adad-46cb26931221 service nova] Releasing lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:09:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.154s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received event network-vif-plugged-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] No waiting events found dispatching network-vif-plugged-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:49 user nova-compute[71482]: WARNING nova.compute.manager [req-ace41b0f-e8ad-4f63-894c-25e7f054f89c req-894d4d29-8a21-438a-916b-fb5c150ca6d9 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received unexpected event network-vif-plugged-60f2af8d-b456-4efe-b146-cc700b68733e for instance with vm_state building and task_state spawning.
Apr 12 09:09:49 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:09:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290591.7578878, a5e42339-50fa-411c-94a1-c350727b7955 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a5e42339-50fa-411c-94a1-c350727b7955] VM Resumed (Lifecycle Event)
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:51 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Instance spawned successfully.
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:09:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a5e42339-50fa-411c-94a1-c350727b7955] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290591.7608306, a5e42339-50fa-411c-94a1-c350727b7955 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:09:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a5e42339-50fa-411c-94a1-c350727b7955] VM Started (Lifecycle Event)
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:09:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a5e42339-50fa-411c-94a1-c350727b7955] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:09:51 user nova-compute[71482]: INFO nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Took 6.99 seconds to spawn the instance on the hypervisor.
Apr 12 09:09:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:09:51 user nova-compute[71482]: INFO nova.compute.manager [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Took 8.41 seconds to build instance.
Apr 12 09:09:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f7b47-8b2a-4e17-968e-0b666328caed tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.641s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received event network-vif-plugged-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:09:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:09:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:09:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:09:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] No waiting events found dispatching network-vif-plugged-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:09:52 user nova-compute[71482]: WARNING nova.compute.manager [req-eb0336db-ffa2-4111-b7b3-4bd5f21bf5cc req-a2617728-b82b-4e64-8e9b-6b8dc08679bb service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received unexpected event network-vif-plugged-60f2af8d-b456-4efe-b146-cc700b68733e for instance with vm_state active and task_state None.
Apr 12 09:09:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:09:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:10:31 user nova-compute[71482]: INFO nova.compute.manager [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] instance snapshotting
Apr 12 09:10:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Beginning live snapshot process
Apr 12 09:10:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json -f qcow2 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json -f qcow2" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json -f qcow2 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8818as0a/7b9d1adb43594046a51822f79bcb0338.delta 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8818as0a/7b9d1adb43594046a51822f79bcb0338.delta 1073741824" returned: 0 in 0.047s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 09:10:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71482) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 12 09:10:31 user nova-compute[71482]: INFO nova.virt.libvirt.host [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] UEFI support detected
Apr 12 09:10:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:10:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:10:33 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 09:10:33 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:10:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8818as0a/7b9d1adb43594046a51822f79bcb0338.delta /opt/stack/data/nova/instances/snapshots/tmp8818as0a/7b9d1adb43594046a51822f79bcb0338 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8818as0a/7b9d1adb43594046a51822f79bcb0338.delta /opt/stack/data/nova/instances/snapshots/tmp8818as0a/7b9d1adb43594046a51822f79bcb0338" returned: 0 in 0.329s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:33 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Snapshot extracted, beginning image upload
Apr 12 09:10:35 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Snapshot image upload complete
Apr 12 09:10:35 user nova-compute[71482]: INFO nova.compute.manager [None req-038ce057-dffa-49ef-ab90-2ea736548aa2 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Took 4.42 seconds to snapshot the instance on the hypervisor.
Apr 12 09:10:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:10:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:10:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:10:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:10:41 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:10:41 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Updating instance_info_cache with network_info: [{"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:10:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:10:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:10:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:10:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG nova.objects.instance [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lazy-loading 'flavor' on Instance uuid 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:47 user nova-compute[71482]: INFO nova.compute.manager [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Attaching volume 66411b86-ffc7-4ced-840e-8fe743302ed1 to /dev/vdb
Apr 12 09:10:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG os_brick.utils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:10:47 user nova-compute[71482]: INFO oslo.privsep.daemon [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpiqek5421/privsep.sock']
Apr 12 09:10:47 user sudo[82384]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpiqek5421/privsep.sock
Apr 12 09:10:47 user sudo[82384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 12 09:10:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:47 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:10:47 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:10:47 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7558MB free_disk=26.53827667236328GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f683bc12-8fca-47de-b28e-a0070e77b387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 94f40323-58a6-4e9c-b26b-23615dde13d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a5e42339-50fa-411c-94a1-c350727b7955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 22eabe74-0932-472e-8090-09e8431f4f4a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-changed-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Refreshing instance network info cache due to event network-changed-dc64c2a8-533c-40df-b88e-c059cb9cda89. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] Acquiring lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] Acquired lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Refreshing network info cache for port dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updated VIF entry in instance network info cache for port dc64c2a8-533c-40df-b88e-c059cb9cda89. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:10:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05180043-58f3-47e4-9911-bd82db488bbd req-c46bb860-1409-4717-a294-53d8247313ae service nova] Releasing lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:10:48 user sudo[82384]: pam_unix(sudo:session): session closed for user root
Apr 12 09:10:48 user nova-compute[71482]: INFO oslo.privsep.daemon [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Spawned new privsep daemon via rootwrap
Apr 12 09:10:49 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 12 09:10:49 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 12 09:10:49 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 12 09:10:49 user nova-compute[71482]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82392
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ae7a5f-109f-4eac-9c86-d332ac2a39ef]: (2,) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d75fcf-e8f1-46a8-8436-a88af1ad7df1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:49 user nova-compute[71482]: WARNING os_brick.initiator.connectors.nvmeof [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f1937-ea13-4bc9-85ef-9021034fe0ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1421a5-f55c-4b50-a5a3-5276f45374e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[78326750-d668-4891-9181-cb36c78ef4e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:10:49 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd5a1c7-66ee-439c-836f-f517c0c8ef6f]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG os_brick.utils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] <== get_connector_properties: return (1967ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Updating existing volume attachment record: 6edf4dbd-4612-4b7c-86ab-4e46555e4e00 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:49 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:10:50 user nova-compute[71482]: INFO nova.compute.manager [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Rescuing
Apr 12 09:10:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:10:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquired lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:10:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG nova.network.neutron [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updating instance_info_cache with network_info: [{"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Releasing lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-unplugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] No waiting events found dispatching network-vif-unplugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:10:51 user nova-compute[71482]: WARNING nova.compute.manager [req-b8be0574-2317-49e6-98d9-01b00d8b921d req-99b382c0-b24c-444d-8438-b1857b4cf425 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received unexpected event network-vif-unplugged-44c4d894-3c30-4528-95cd-37f612257156 for instance with vm_state active and task_state rescuing.
Apr 12 09:10:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Instance destroyed successfully.
Apr 12 09:10:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Attempting rescue
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Instance directory exists: not creating {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 09:10:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Creating image(s)
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.126s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue" returned: 0 in 0.047s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'migration_context' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Start _get_guest_xml network_info=[{"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "vif_mac": "fa:16:3e:04:2d:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'resources' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:52 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:10:52 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967968381',display_name='tempest-ServerRescueNegativeTestJSON-server-1967968381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967968381',id=6,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-0hs4rd5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:20Z,user_data=None,user_id='7f6b983634234693ba04a3097c2a129b',uuid=6f58bf6a-beec-40e5-b8be-de03539038f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "vif_mac": "fa:16:3e:04:2d:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "vif_mac": "fa:16:3e:04:2d:9f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4d894-3c30-4528-95cd-37f612257156,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4d894-3c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:10:52 user nova-compute[71482]:   <uuid>6f58bf6a-beec-40e5-b8be-de03539038f8</uuid>
Apr 12 09:10:52 user nova-compute[71482]:   <name>instance-00000006</name>
Apr 12 09:10:52 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:10:52 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:10:52 user nova-compute[71482]:   <metadata>
Apr 12 09:10:52 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:10:52 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:10:52 user nova-compute[71482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1967968381</nova:name>
Apr 12 09:10:52 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:10:52</nova:creationTime>
Apr 12 09:10:52 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:10:52 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:10:52 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:10:52 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:10:52 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:10:52 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:10:52 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:10:52 user nova-compute[71482]:       <nova:owner>
Apr 12 09:10:52 user nova-compute[71482]:         <nova:user uuid="7f6b983634234693ba04a3097c2a129b">tempest-ServerRescueNegativeTestJSON-480181232-project-member</nova:user>
Apr 12 09:10:52 user nova-compute[71482]:         <nova:project uuid="1c3cc8ab6ab244b1badb6fea347d64ea">tempest-ServerRescueNegativeTestJSON-480181232</nova:project>
Apr 12 09:10:52 user nova-compute[71482]:       </nova:owner>
Apr 12 09:10:52 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:10:52 user nova-compute[71482]:       <nova:ports>
Apr 12 09:10:52 user nova-compute[71482]:         <nova:port uuid="44c4d894-3c30-4528-95cd-37f612257156">
Apr 12 09:10:52 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 09:10:52 user nova-compute[71482]:         </nova:port>
Apr 12 09:10:52 user nova-compute[71482]:       </nova:ports>
Apr 12 09:10:52 user nova-compute[71482]:     </nova:instance>
Apr 12 09:10:52 user nova-compute[71482]:   </metadata>
Apr 12 09:10:52 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:10:52 user nova-compute[71482]:     <system>
Apr 12 09:10:52 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:10:52 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:10:52 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:10:52 user nova-compute[71482]:       <entry name="serial">6f58bf6a-beec-40e5-b8be-de03539038f8</entry>
Apr 12 09:10:52 user nova-compute[71482]:       <entry name="uuid">6f58bf6a-beec-40e5-b8be-de03539038f8</entry>
Apr 12 09:10:52 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:10:52 user nova-compute[71482]:     </system>
Apr 12 09:10:52 user nova-compute[71482]:   </sysinfo>
Apr 12 09:10:52 user nova-compute[71482]:   <os>
Apr 12 09:10:52 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:10:52 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:10:52 user nova-compute[71482]:   </os>
Apr 12 09:10:52 user nova-compute[71482]:   <features>
Apr 12 09:10:52 user nova-compute[71482]:     <acpi/>
Apr 12 09:10:52 user nova-compute[71482]:     <apic/>
Apr 12 09:10:52 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:10:52 user nova-compute[71482]:   </features>
Apr 12 09:10:52 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:10:52 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:10:52 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:10:52 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:10:52 user nova-compute[71482]:   </clock>
Apr 12 09:10:52 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:10:52 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:10:52 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:10:52 user nova-compute[71482]:   </cpu>
Apr 12 09:10:52 user nova-compute[71482]:   <devices>
Apr 12 09:10:52 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:10:52 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:10:52 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue"/>
Apr 12 09:10:52 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:10:52 user nova-compute[71482]:     </disk>
Apr 12 09:10:52 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:10:52 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:10:52 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk"/>
Apr 12 09:10:52 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:10:52 user nova-compute[71482]:     </disk>
Apr 12 09:10:52 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:10:52 user nova-compute[71482]:       <mac address="fa:16:3e:04:2d:9f"/>
Apr 12 09:10:52 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:10:52 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:10:52 user nova-compute[71482]:       <target dev="tap44c4d894-3c"/>
Apr 12 09:10:52 user nova-compute[71482]:     </interface>
Apr 12 09:10:52 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:10:52 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/console.log" append="off"/>
Apr 12 09:10:52 user nova-compute[71482]:     </serial>
Apr 12 09:10:52 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:10:52 user nova-compute[71482]:     <video>
Apr 12 09:10:52 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:10:52 user nova-compute[71482]:     </video>
Apr 12 09:10:52 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:10:52 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:10:52 user nova-compute[71482]:     </rng>
Apr 12 09:10:52 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:10:52 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:10:52 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:10:52 user nova-compute[71482]:     </memballoon>
Apr 12 09:10:52 user nova-compute[71482]:   </devices>
Apr 12 09:10:52 user nova-compute[71482]: </domain>
Apr 12 09:10:52 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:10:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Instance destroyed successfully.
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No VIF found with MAC fa:16:3e:04:2d:9f, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connector [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Factory for ISCSI on None {{(pid=71482) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCsYbTXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:10:53 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:10:53 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:10:53 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04c2cb6-4328-455b-9477-bc1acb7a7cac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:10:53 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4aeb4d-0a49-426e-a434-728a7982fbcf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1] added
Apr 12 09:10:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8417eef-70fe-424e-86ab-ad18463e9817]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec8bbd9-f801-423d-836e-4b85d496e476]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCsYbTXZ {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dCsYbTXZ" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[97887d61-3f59-47de-b88f-04fe7dd99faa]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dCsYbTXZ'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[606437f6-b3bd-454c-90bb-3c1456f26316]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-changed-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Refreshing instance network info cache due to event network-changed-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Acquiring lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Acquired lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG nova.network.neutron [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Refreshing network info cache for port e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[63205167-c984-4f9b-aa43-bcdf6c94b00c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:10:53 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:10:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:10:53 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:10:53 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:10:53 user nova-compute[71482]: 
Apr 12 09:10:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG nova.objects.instance [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c4b0d5-b37d-43fc-ac82-a8e04dcf0084]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1, portal: 172.16.0.220,3260]
Apr 12 09:10:54 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1, portal: 172.16.0.220,3260] successful.
Apr 12 09:10:54 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e0e53f-06a2-4765-a898-b37dd2c105c0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[069073e3-cebb-48ca-80dd-3678e15fde1a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 (non-flash)
Apr 12 09:10:54 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 (non-flash)
Apr 12 09:10:54 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e16be8-5292-4d56-8890-1402a00619eb]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCsYbTXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:54 user nova-compute[71482]: INFO nova.compute.manager [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Attaching volume a058b665-da02-444b-8e77-862141ce3a61 to /dev/vdb
Apr 12 09:10:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.utils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[77af0dd2-c307-41a3-95ae-489fd666050e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa65a473-936f-4bc3-8a63-4bf02b8ef3c2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[58540daa-4752-48df-b2f7-082d6a9360ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37d3b51-b2d8-49aa-b292-ee854955c027]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:10:54 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb67426-8df7-4ada-a360-71425f090fcd]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG os_brick.utils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updating existing volume attachment record: df48de47-1a88-4dae-8a54-e250c827891b {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG nova.network.neutron [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updated VIF entry in instance network info cache for port e957a8ce-db60-4c11-8fcf-6b88d77e8e4f. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG nova.network.neutron [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updating instance_info_cache with network_info: [{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Releasing lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG nova.compute.manager [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:54 user nova-compute[71482]: DEBUG nova.compute.manager [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] No waiting events found dispatching network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:10:54 user nova-compute[71482]: WARNING nova.compute.manager [req-3464f887-7456-4405-9eba-ce90c6fe839b req-c4c93c53-723a-433c-a784-4ec41aa0cac5 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received unexpected event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 for instance with vm_state active and task_state rescuing.
Apr 12 09:10:55 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '26439343539396636', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439343539396636', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG nova.objects.instance [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lazy-loading 'flavor' on Instance uuid 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:10:55 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:10:55 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:10:55 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:10:55 user nova-compute[71482]:   <serial>66411b86-ffc7-4ced-840e-8fe743302ed1</serial>
Apr 12 09:10:55 user nova-compute[71482]: </disk>
Apr 12 09:10:55 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] No VIF found with MAC fa:16:3e:2e:ca:12, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-439ba480-8aa3-4e6b-8c86-4cb71872d15c tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.571s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:55 user nova-compute[71482]: INFO nova.compute.manager [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Terminating instance
Apr 12 09:10:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] No waiting events found dispatching network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:10:56 user nova-compute[71482]: WARNING nova.compute.manager [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received unexpected event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 for instance with vm_state active and task_state rescuing.
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] No waiting events found dispatching network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:10:56 user nova-compute[71482]: WARNING nova.compute.manager [req-e30c67eb-d87d-4229-bdde-919174901b05 req-2cc5324e-18b0-4ffb-9334-1996ce7f9a07 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received unexpected event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 for instance with vm_state active and task_state rescuing.
Apr 12 09:10:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 6f58bf6a-beec-40e5-b8be-de03539038f8 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290656.1937652, 6f58bf6a-beec-40e5-b8be-de03539038f8 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:10:56 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] VM Resumed (Lifecycle Event)
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-cec3a35b-11ba-41de-825b-38f7f61dba91 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:10:56 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290656.19716, 6f58bf6a-beec-40e5-b8be-de03539038f8 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:10:56 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] VM Started (Lifecycle Event)
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received event network-vif-unplugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] Acquiring lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] No waiting events found dispatching network-vif-unplugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.compute.manager [req-44c18a47-8960-4c86-9398-22c03b952222 req-7fe20994-59d3-4189-a821-ef20605a1f8c service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received event network-vif-unplugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:10:56 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Instance destroyed successfully.
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.objects.instance [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lazy-loading 'resources' on Instance uuid 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1026602398',display_name='tempest-DeleteServersTestJSON-server-1026602398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1026602398',id=2,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c93767066d345a081bd30ca6d52ccd3',ramdisk_id='',reservation_id='r-gqu2qslg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-821159716',owner_user_name='tempest-DeleteServersTestJSON-821159716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:03Z,user_data=None,user_id='69a651c616da4b3b98a71a43b07512d9',uuid=9c107ac6-adbb-4e6d-835a-4f6e7fa6f185,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Converting VIF {"id": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "address": "fa:16:3e:2e:ca:12", "network": {"id": "c2c7e602-9c91-45a0-9625-07d734f10331", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1074671465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c93767066d345a081bd30ca6d52ccd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ac7d1a-2c", "ovs_interfaceid": "04ac7d1a-2c1d-4599-b8d7-5cfe5530f700", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ca:12,bridge_name='br-int',has_traffic_filtering=True,id=04ac7d1a-2c1d-4599-b8d7-5cfe5530f700,network=Network(c2c7e602-9c91-45a0-9625-07d734f10331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ac7d1a-2c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_vif [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ca:12,bridge_name='br-int',has_traffic_filtering=True,id=04ac7d1a-2c1d-4599-b8d7-5cfe5530f700,network=Network(c2c7e602-9c91-45a0-9625-07d734f10331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ac7d1a-2c') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ac7d1a-2c, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:56 user nova-compute[71482]: INFO os_vif [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ca:12,bridge_name='br-int',has_traffic_filtering=True,id=04ac7d1a-2c1d-4599-b8d7-5cfe5530f700,network=Network(c2c7e602-9c91-45a0-9625-07d734f10331),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ac7d1a-2c')
Apr 12 09:10:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dCsYbTXZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:10:56 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c9632-e0fe-4980-b8b7-aa90fb87b5f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:10:56 user nova-compute[71482]: No targets found.
Apr 12 09:10:56 user nova-compute[71482]: iSNS:
Apr 12 09:10:56 user nova-compute[71482]: No targets found.
Apr 12 09:10:56 user nova-compute[71482]: STATIC:
Apr 12 09:10:56 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1
Apr 12 09:10:56 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:10:56 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:10:56 user nova-compute[71482]: FIRMWARE:
Apr 12 09:10:56 user nova-compute[71482]: No targets found.
Apr 12 09:10:56 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:10:56 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:10:56 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce48f44-c692-4f1b-a68e-38128291a176]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b12a1b-b22e-4554-9835-315848a6ddb6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 (non-flash)
Apr 12 09:10:56 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 (non-flash)
Apr 12 09:10:56 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c165750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[279eecbe-8151-486a-9923-00a30abc4cef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0170f302-2978-4bc9-80ee-4b5b3639e13d]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3526dca-534e-479c-842f-ce3b179b9db9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:10:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[009dd95f-2e3d-432d-84c0-443de6660cea]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c0e230-820f-43c0-a002-946587ebe354]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a2610-f087-4691-b956-c5114cf3fd40]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1, portal: 172.16.0.220,3260]
Apr 12 09:10:57 user nova-compute[71482]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1, portal: 172.16.0.220,3260] successful.
Apr 12 09:10:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66411b86-ffc7-4ced-840e-8fe743302ed1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea78fba9-ad16-4192-a566-910931edaee5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] <== disconnect_volume: return (293ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:10:57 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Deleting instance files /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185_del
Apr 12 09:10:57 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Deletion of /opt/stack/data/nova/instances/9c107ac6-adbb-4e6d-835a-4f6e7fa6f185_del complete
Apr 12 09:10:57 user nova-compute[71482]: INFO nova.compute.manager [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 12 09:10:57 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:10:57 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:10:57 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Took 0.59 seconds to deallocate network for instance.
Apr 12 09:10:58 user nova-compute[71482]: DEBUG nova.compute.manager [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received event network-vif-plugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:10:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] Acquiring lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:58 user nova-compute[71482]: DEBUG nova.compute.manager [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] No waiting events found dispatching network-vif-plugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:10:58 user nova-compute[71482]: WARNING nova.compute.manager [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received unexpected event network-vif-plugged-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 for instance with vm_state active and task_state deleting.
Apr 12 09:10:58 user nova-compute[71482]: DEBUG nova.compute.manager [req-46fc8639-e84d-4fab-8c4a-f6a8722d6e53 req-2c6df2c4-3abe-4b99-8887-e6802e59af57 service nova] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Received event network-vif-deleted-04ac7d1a-2c1d-4599-b8d7-5cfe5530f700 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:10:58 user nova-compute[71482]: INFO nova.compute.manager [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Took 0.91 seconds to detach 1 volumes for instance.
Apr 12 09:10:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:10:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWzKUNkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:10:59 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:10:59 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:10:59 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[63225cb0-63e6-41bf-8134-4812268f15c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:10:59 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4863189c-b987-46e8-b74a-4febdea1b2ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61] added
Apr 12 09:10:59 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fd7284-0b67-4154-9c8e-49f4a5201391]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bccf7f-5be8-4761-b144-1db6134c491f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWzKUNkr {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Deleted allocations for instance 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWzKUNkr" returned: 0 in 0.032s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a693a1-03fb-4f1c-a0cd-91f85466e4b8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWzKUNkr'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0924db-cbd4-4588-8edf-f495cab57d07]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[649777a3-5ef4-4d92-b9df-dbb89ffbfd54]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:10:59 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:10:59 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:10:59 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:10:59 user nova-compute[71482]: 
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ae47fba5-4674-419e-9216-2d47b3c91d1f tempest-DeleteServersTestJSON-821159716 tempest-DeleteServersTestJSON-821159716-project-member] Lock "9c107ac6-adbb-4e6d-835a-4f6e7fa6f185" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.310s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3566837-2acd-4cd4-a59a-df703c30f59f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260]
Apr 12 09:10:59 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260] successful.
Apr 12 09:10:59 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a08abf-d7d6-4196-8e29-768def71789d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f494ad7f-7ea1-494e-8c8b-d6530b7c9b1f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:10:59 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:10:59 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[32226757-a7a0-49bb-b13d-9b8fef5e59f4]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:10:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWzKUNkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:11:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26437383132333634', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437383132333634', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:11:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:11:00 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:00 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:11:00 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:00 user nova-compute[71482]:   <serial>a058b665-da02-444b-8e77-862141ce3a61</serial>
Apr 12 09:11:00 user nova-compute[71482]: </disk>
Apr 12 09:11:00 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:11:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No VIF found with MAC fa:16:3e:f3:e5:20, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:11:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-6f9ff1f4-63ae-4416-a46d-bb2f14b845d5 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.649s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:11:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71482) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 09:11:01 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-unplugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-unplugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:02 user nova-compute[71482]: WARNING nova.compute.manager [req-90d07342-bc7a-4168-989f-2115cb7b99e2 req-d9b8d9ac-f509-48d3-869b-0b711030e6a1 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-unplugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state active and task_state powering-off.
Apr 12 09:11:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance destroyed successfully.
Apr 12 09:11:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:11:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b466fe1a-1974-40f5-ac13-b005a7024a2c tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.854s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:04 user nova-compute[71482]: WARNING nova.compute.manager [req-1f3ae34d-e03f-4473-a842-30f13aa4214d req-6cf60531-1a7a-4b75-b8b9-6b1198240e1a service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state stopped and task_state None.
Apr 12 09:11:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received event network-changed-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Refreshing instance network info cache due to event network-changed-d3cd67b3-275a-4eef-b0c5-b2da33a783f9. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] Acquiring lock "refresh_cache-94f40323-58a6-4e9c-b26b-23615dde13d3" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] Acquired lock "refresh_cache-94f40323-58a6-4e9c-b26b-23615dde13d3" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Refreshing network info cache for port d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG nova.objects.instance [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lazy-loading 'flavor' on Instance uuid 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:09 user nova-compute[71482]: INFO nova.compute.manager [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Attaching volume 297e37c3-cfa1-4064-98b5-4565c088c320 to /dev/vdb
Apr 12 09:11:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Updated VIF entry in instance network info cache for port d3cd67b3-275a-4eef-b0c5-b2da33a783f9. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Updating instance_info_cache with network_info: [{"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3d191ce1-7d13-47a1-9ee8-65637760c81a req-c7a08f18-094e-42cf-afa9-96f7750c7fcc service nova] Releasing lock "refresh_cache-94f40323-58a6-4e9c-b26b-23615dde13d3" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG os_brick.utils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0061ba-1889-49ca-81d5-131e744d9526]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[65edf5cb-150e-4dfb-95a2-db54f87455a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de88142-936c-45d6-b0d7-bca526dda2ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c79f21-5a3b-4dd5-96a5-198afed84a10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:09 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:11:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7272976-0634-41a7-82db-aa1667410961]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG os_brick.utils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:09 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Updating existing volume attachment record: 6f261ba2-184b-472b-aeed-7c141bafda6f {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:11:11 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290656.789507, 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:11:11 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] VM Stopped (Lifecycle Event)
Apr 12 09:11:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f5c5a48b-d849-46c2-a699-2142493985d6 None None] [instance: 9c107ac6-adbb-4e6d-835a-4f6e7fa6f185] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:11:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received event network-changed-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Refreshing instance network info cache due to event network-changed-473a9253-5ee7-4ef1-bd1a-f260bc80b158. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:11:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] Acquiring lock "refresh_cache-1d0bc5da-ed98-417a-9fc1-1f636887f035" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] Acquired lock "refresh_cache-1d0bc5da-ed98-417a-9fc1-1f636887f035" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:13 user nova-compute[71482]: DEBUG nova.network.neutron [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Refreshing network info cache for port 473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:11:13 user nova-compute[71482]: DEBUG nova.network.neutron [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Updated VIF entry in instance network info cache for port 473a9253-5ee7-4ef1-bd1a-f260bc80b158. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:11:13 user nova-compute[71482]: DEBUG nova.network.neutron [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Updating instance_info_cache with network_info: [{"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-73321a77-39ec-4313-a3a7-8e9fdc73545c req-7952c2c3-968f-4d7a-953c-6262c5f24dfd service nova] Releasing lock "refresh_cache-1d0bc5da-ed98-417a-9fc1-1f636887f035" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvyPecQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:14 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:14 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:14 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32941ea-0568-4330-8b6f-6f09da4f40e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:11:14 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b70d4e-3d72-4c33-bdc4-1e13b916b1e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320] added
Apr 12 09:11:14 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[746ee671-dfa0-41d8-a2e0-34851e968163]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3796e46f-57aa-4606-b15e-d5cf3087fc32]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvyPecQB {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG nova.objects.instance [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'flavor' on Instance uuid 1d0bc5da-ed98-417a-9fc1-1f636887f035 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvyPecQB" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8210c831-dcbc-4771-a601-210ab51ad411]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NvyPecQB'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed50c1d7-124d-4ed5-8b15-b78a1eaf783e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9783b610-d311-449e-a834-2b7ae55302f6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:14 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:14 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cbba90-2850-4d0f-95c8-2aa571368406]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260]
Apr 12 09:11:14 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:14 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc25382a-4eae-4e9a-9fb1-15e254e2fda9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32c5c0e-619f-4fac-a0ac-a8d1e392b18a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:14 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:14 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:14 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:14 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[495724a5-2b47-4fb8-a3c6-f0d48d21c6d0]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvyPecQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:14 user nova-compute[71482]: INFO nova.compute.manager [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Attaching volume 711ec528-9d10-4441-99fd-7bd08c524292 to /dev/vdb
Apr 12 09:11:14 user nova-compute[71482]: DEBUG os_brick.utils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9394d2-9af8-49e8-8937-f59389dbfe45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa367bd-941a-4908-b54b-4d28f8e8594d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[095788ec-9289-4c45-ae71-ec3e4cfb19ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f877c1-b434-45a8-8929-ac656bdd5c5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:15 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:11:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bb6a0c-8e4e-4f56-9a52-7cce96b6a66d]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG os_brick.utils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] <== get_connector_properties: return (489ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Updating existing volume attachment record: 4a3937c6-a2e1-41de-ae92-7aa2fab3a453 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26463313333343235', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313333343235', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG nova.objects.instance [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lazy-loading 'flavor' on Instance uuid 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:11:15 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:15 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:11:15 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:15 user nova-compute[71482]:   <serial>297e37c3-cfa1-4064-98b5-4565c088c320</serial>
Apr 12 09:11:15 user nova-compute[71482]: </disk>
Apr 12 09:11:15 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:11:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] No VIF found with MAC fa:16:3e:e7:c0:df, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:11:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1969970d-34f3-43fa-8398-48ced19021e1 tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.807s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG os_brick.utils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[603eb7c4-fb24-42ef-98b3-e8186b8b5c59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c28153b-17b6-4923-a783-d3141ff61825]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab962d8-1b84-4bad-a525-97ed589e26b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f716de04-7819-42f9-8907-eb7874e5123e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:17 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:11:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3be99ca-354d-4d1b-82e4-d47e7cf44fef]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG os_brick.utils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:17 user nova-compute[71482]: INFO nova.compute.manager [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Swapping volume 297e37c3-cfa1-4064-98b5-4565c088c320 for 8efa7873-7011-4a2d-9e41-54b8ed92441a
Apr 12 09:11:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290662.7686167, f683bc12-8fca-47de-b28e-a0070e77b387 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:11:17 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] VM Stopped (Lifecycle Event)
Apr 12 09:11:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bf8b979d-31f5-4e7c-889d-62bffdc2635f None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:11:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bf8b979d-31f5-4e7c-889d-62bffdc2635f None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:11:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-changed-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Refreshing instance network info cache due to event network-changed-c7ccda6d-74db-4747-a5eb-dba5e82506fa. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:11:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] Acquiring lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] Acquired lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:20 user nova-compute[71482]: DEBUG nova.network.neutron [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Refreshing network info cache for port c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "interface-fbbb84fb-1d35-4249-8c8a-d9a02176243c-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "interface-fbbb84fb-1d35-4249-8c8a-d9a02176243c-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'flavor' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG nova.network.neutron [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updated VIF entry in instance network info cache for port c7ccda6d-74db-4747-a5eb-dba5e82506fa. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG nova.network.neutron [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating instance_info_cache with network_info: [{"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'pci_requests' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-676a9aa3-5f41-409c-b3cd-6518ce2c89b6 req-2c97d552-4078-462e-b6ae-8f2cf45d91d0 service nova] Releasing lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG nova.policy [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc97c54107de479bade4014982d79287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed443186516c4075ab14a4b0be130e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received event network-changed-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Refreshing instance network info cache due to event network-changed-f3af3839-bbd2-4152-ab34-91c767220af4. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] Acquiring lock "refresh_cache-22eabe74-0932-472e-8090-09e8431f4f4a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] Acquired lock "refresh_cache-22eabe74-0932-472e-8090-09e8431f4f4a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG nova.network.neutron [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Refreshing network info cache for port f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:11:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcvEAlaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:22 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:22 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:22 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadcf58b-8f8e-4d15-9435-35617e68358a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:11:22 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e190a19-31c6-4cc9-a6b0-7f4a6ca268d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292] added
Apr 12 09:11:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d5f170-3136-4dcc-8127-42950d2038f0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6193dc-e5b7-4e9f-ac13-b6e91366349f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcvEAlaJ {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XcvEAlaJ" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf98e93-02be-421c-a813-b59e9224c90d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XcvEAlaJ'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5590718c-0e62-4450-8eea-085356f0b053]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de72c51-9724-4093-a62a-4738e708db60]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdccd27c-eda7-424e-bc69-4f052d6593df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292, portal: 172.16.0.220,3260]
Apr 12 09:11:22 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba479c7-6c68-4be4-a99b-c7d61277075e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[781ec6b3-ad76-4678-9c4a-5962f00d6f58]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)
Apr 12 09:11:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8475b57b-7a01-4cd6-a4a5-6bdcb5ee09ef]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcvEAlaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG nova.network.neutron [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Successfully created port: 15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:11:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.network.neutron [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Updated VIF entry in instance network info cache for port f3af3839-bbd2-4152-ab34-91c767220af4. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.network.neutron [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Updating instance_info_cache with network_info: [{"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f22eb7ba-e6ee-4793-a65b-a55d4a8b7dba req-76e30cd2-ee1d-4fe1-bee3-16e1727c2e32 service nova] Releasing lock "refresh_cache-22eabe74-0932-472e-8090-09e8431f4f4a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23664626632316234', 'path': '/dev/sdd'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664626632316234', 'path': '/dev/sdd'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.objects.instance [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'flavor' on Instance uuid 1d0bc5da-ed98-417a-9fc1-1f636887f035 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:11:23 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:23 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:11:23 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:23 user nova-compute[71482]:   <serial>711ec528-9d10-4441-99fd-7bd08c524292</serial>
Apr 12 09:11:23 user nova-compute[71482]: </disk>
Apr 12 09:11:23 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Successfully updated port: 15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquired lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.compute.manager [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-changed-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.compute.manager [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Refreshing instance network info cache due to event network-changed-15e598ed-6d82-4978-9ea7-57da256807b3. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] Acquiring lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] No VIF found with MAC fa:16:3e:b0:30:3c, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24516499-1c29-4d35-b9bc-3f34faac0238 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.378s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqNvPSFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94f40323-58a6-4e9c-b26b-23615dde13d3', 'attached_at': '', 'detached_at': '', 'volume_id': '8efa7873-7011-4a2d-9e41-54b8ed92441a', 'serial': '8efa7873-7011-4a2d-9e41-54b8ed92441a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvyPecQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '94f40323-58a6-4e9c-b26b-23615dde13d3', 'attached_at': '', 'detached_at': '', 'volume_id': '297e37c3-cfa1-4064-98b5-4565c088c320', 'serial'} {{(pid=71482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqNvPSFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:24 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:24 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:24 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccf2a94-ab88-4859-bb80-88eae268bc35]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:11:24 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6059d3-13fc-4d42-a8c6-8d02871db8c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a] added
Apr 12 09:11:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65a672a-8b25-4179-bc5c-77dd7882f85d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[07442bb9-cb86-434d-8387-7e68cc30011d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqNvPSFC {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqNvPSFC" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f246bd-a028-4b45-8677-edae3d0f51c1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqNvPSFC'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacfd52f-8671-4b67-86c8-95ed6d5c9a81]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4796df0-df27-48f5-a916-a8de591b7ed8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c61c9c-07ff-43cc-8b55-8c8cc1a1317a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a, portal: 172.16.0.220,3260]
Apr 12 09:11:24 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eea946e-cd0b-4b67-a37c-9fc40a7f2c1f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.network.neutron [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating instance_info_cache with network_info: [{"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee90e08-029e-4882-927b-b99ecaa95813]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)
Apr 12 09:11:24 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Releasing lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] Acquired lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.network.neutron [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Refreshing network info cache for port 15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091699595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2091699595',id=9,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ==',key_name='tempest-keypair-591560650',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed443186516c4075ab14a4b0be130e31',ramdisk_id='',reservation_id='r-zd9zb9ej',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1337552011',owner_user_name='tempest-TaggedAttachmentsTest-1337552011-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc97c54107de479bade4014982d79287',uuid=fbbb84fb-1d35-4249-8c8a-d9a02176243c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converting VIF {"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_vif [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5983abc2-a881-4e73-8d45-ffa2f235b9c9]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqNvPSFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15e598ed-6d, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap15e598ed-6d, col_values=(('external_ids', {'iface-id': '15e598ed-6d82-4978-9ea7-57da256807b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:4e:39', 'vm-uuid': 'fbbb84fb-1d35-4249-8c8a-d9a02176243c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:24 user nova-compute[71482]: INFO os_vif [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d')
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091699595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2091699595',id=9,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ==',key_name='tempest-keypair-591560650',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed443186516c4075ab14a4b0be130e31',ramdisk_id='',reservation_id='r-zd9zb9ej',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1337552011',owner_user_name='tempest-TaggedAttachmentsTest-1337552011-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc97c54107de479bade4014982d79287',uuid=fbbb84fb-1d35-4249-8c8a-d9a02176243c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converting VIF {"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] attach device xml: <interface type="ethernet">
Apr 12 09:11:24 user nova-compute[71482]:   <mac address="fa:16:3e:fa:4e:39"/>
Apr 12 09:11:24 user nova-compute[71482]:   <model type="virtio"/>
Apr 12 09:11:24 user nova-compute[71482]:   <mtu size="1442"/>
Apr 12 09:11:24 user nova-compute[71482]:   <target dev="tap15e598ed-6d"/>
Apr 12 09:11:24 user nova-compute[71482]: </interface>
Apr 12 09:11:24 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lazy-loading 'flavor' on Instance uuid 22eabe74-0932-472e-8090-09e8431f4f4a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:24 user nova-compute[71482]: INFO nova.compute.manager [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Attaching volume 0e4efab7-f288-474b-8263-3dd11305b630 to /dev/sdc
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-plugged-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] No waiting events found dispatching network-vif-plugged-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:24 user nova-compute[71482]: WARNING nova.compute.manager [req-95ff93bf-2078-40b0-be5c-8c41979448fb req-724c6461-245f-4d04-b0fa-c26ad84e4924 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received unexpected event network-vif-plugged-15e598ed-6d82-4978-9ea7-57da256807b3 for instance with vm_state active and task_state None.
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.utils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea0c6f3-6885-41d7-bd3b-699b4774c1a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e033e5-5d9f-4e18-9d80-8febc4f03bd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39fa87c-d802-431c-b639-ed429635afd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbf54e1-ee85-4a2a-a454-527c3af8cba2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] No BDM found with device name hda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] No VIF found with MAC fa:16:3e:3d:0e:e4, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:24 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:11:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf2ade1-caf2-4d3d-b6dc-850c58d8e132]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG os_brick.utils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:24 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Updating existing volume attachment record: 15ecd256-7613-4476-9339-98fc4f7144c8 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:11:25 user nova-compute[71482]:   <nova:package version="0.0.0"/>
Apr 12 09:11:25 user nova-compute[71482]:   <nova:name>tempest-device-tagging-server-2091699595</nova:name>
Apr 12 09:11:25 user nova-compute[71482]:   <nova:creationTime>2023-04-12 09:11:24</nova:creationTime>
Apr 12 09:11:25 user nova-compute[71482]:   <nova:flavor name="m1.nano">
Apr 12 09:11:25 user nova-compute[71482]:     <nova:memory>128</nova:memory>
Apr 12 09:11:25 user nova-compute[71482]:     <nova:disk>1</nova:disk>
Apr 12 09:11:25 user nova-compute[71482]:     <nova:swap>0</nova:swap>
Apr 12 09:11:25 user nova-compute[71482]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:11:25 user nova-compute[71482]:     <nova:vcpus>1</nova:vcpus>
Apr 12 09:11:25 user nova-compute[71482]:   </nova:flavor>
Apr 12 09:11:25 user nova-compute[71482]:   <nova:owner>
Apr 12 09:11:25 user nova-compute[71482]:     <nova:user uuid="bc97c54107de479bade4014982d79287">tempest-TaggedAttachmentsTest-1337552011-project-member</nova:user>
Apr 12 09:11:25 user nova-compute[71482]:     <nova:project uuid="ed443186516c4075ab14a4b0be130e31">tempest-TaggedAttachmentsTest-1337552011</nova:project>
Apr 12 09:11:25 user nova-compute[71482]:   </nova:owner>
Apr 12 09:11:25 user nova-compute[71482]:   <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:11:25 user nova-compute[71482]:   <nova:ports>
Apr 12 09:11:25 user nova-compute[71482]:     <nova:port uuid="c7ccda6d-74db-4747-a5eb-dba5e82506fa">
Apr 12 09:11:25 user nova-compute[71482]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:11:25 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:25 user nova-compute[71482]:     <nova:port uuid="15e598ed-6d82-4978-9ea7-57da256807b3">
Apr 12 09:11:25 user nova-compute[71482]:       <nova:ip type="fixed" address="10.10.10.144" ipVersion="4"/>
Apr 12 09:11:25 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:25 user nova-compute[71482]:   </nova:ports>
Apr 12 09:11:25 user nova-compute[71482]: </nova:instance>
Apr 12 09:11:25 user nova-compute[71482]:  {{(pid=71482) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5fe7f1a6-a5d0-4ff7-9edf-1d2c364847f9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "interface-fbbb84fb-1d35-4249-8c8a-d9a02176243c-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.046s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.network.neutron [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updated VIF entry in instance network info cache for port 15e598ed-6d82-4978-9ea7-57da256807b3. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.network.neutron [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating instance_info_cache with network_info: [{"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e23bb310-022e-43a4-a546-9fb3aece8d59 req-25a06b03-8f73-4942-872d-f8ec18e6ca92 service nova] Releasing lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:25 user nova-compute[71482]: INFO nova.compute.manager [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Detaching volume 711ec528-9d10-4441-99fd-7bd08c524292
Apr 12 09:11:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26332383730396364', 'path': '/dev/sde'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332383730396364', 'path': '/dev/sde'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lazy-loading 'flavor' on Instance uuid 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:25 user nova-compute[71482]: INFO nova.virt.block_device [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Attempting to driver detach volume 711ec528-9d10-4441-99fd-7bd08c524292 from mountpoint /dev/vdb
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'flavor' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Attempting to detach device vdb from instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:25 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:25 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:11:25 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:25 user nova-compute[71482]:   <serial>711ec528-9d10-4441-99fd-7bd08c524292</serial>
Apr 12 09:11:25 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:11:25 user nova-compute[71482]: </disk>
Apr 12 09:11:25 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:25 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Successfully detached device vdb from instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 from the persistent domain config.
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:25 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:25 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:11:25 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:25 user nova-compute[71482]:   <serial>711ec528-9d10-4441-99fd-7bd08c524292</serial>
Apr 12 09:11:25 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:11:25 user nova-compute[71482]: </disk>
Apr 12 09:11:25 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:25 user nova-compute[71482]: INFO nova.compute.manager [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Attaching volume e4807592-9afe-402c-b7b4-68ce06c585da to /dev/vdb
Apr 12 09:11:25 user nova-compute[71482]: DEBUG os_brick.utils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a81458d-ea87-49e8-a777-292a94e60abb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50a404d-4557-44f0-8abd-622fa9618d0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[79aab81f-9d80-4ddc-a069-0994733b8422]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cb3747-f82b-4a10-a025-a3eae08e20a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:26 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20aa6ab-da20-4285-b812-6e2ff35fd29a]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.utils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating existing volume attachment record: 8041b7ef-cae0-465f-aca4-54a857dadd54 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681290686.4671881, 1d0bc5da-ed98-417a-9fc1-1f636887f035 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:11:26 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Successfully detached device vdb from instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 from the live domain config.
Apr 12 09:11:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XcvEAlaJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:26 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d17e674-fe6f-46d4-a9b5-cd2e0bcd32fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:11:26 user nova-compute[71482]: No targets found.
Apr 12 09:11:26 user nova-compute[71482]: iSNS:
Apr 12 09:11:26 user nova-compute[71482]: No targets found.
Apr 12 09:11:26 user nova-compute[71482]: STATIC:
Apr 12 09:11:26 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320
Apr 12 09:11:26 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:26 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:26 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a
Apr 12 09:11:26 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:26 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:26 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292
Apr 12 09:11:26 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:26 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:26 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:11:26 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:26 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:26 user nova-compute[71482]: FIRMWARE:
Apr 12 09:11:26 user nova-compute[71482]: No targets found.
Apr 12 09:11:26 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:11:26 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:11:26 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[91533a49-5fe7-499b-92e7-7802a4207391]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccaf0ebb-e8f7-412c-9d34-d7109c649d3c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:26 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:26 user nova-compute[71482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)
Apr 12 09:11:26 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:26 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:26 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:26 user nova-compute[71482]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 (non-flash)
Apr 12 09:11:26 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:26 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c1670a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292'): ({'sdd'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Removing single pathed devices sdd {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45e1220-f3c7-4f46-b7b8-0234fbcd6b2d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e549865-fff5-48fd-8aed-030ec31506ba]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Flushing IO for device /dev/sdd {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f070491-2c17-4d1e-a95f-2348fa27eaa2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a90ac26-1740-4bfb-b01f-9b78616c98df]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc658f-4f24-4b7c-b3a0-a16f791ce94b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ed541e-8c08-4842-89ad-fe8803f3427b]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292, portal: 172.16.0.220,3260]
Apr 12 09:11:26 user nova-compute[71482]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:26 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-plugged-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] No waiting events found dispatching network-vif-plugged-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:26 user nova-compute[71482]: WARNING nova.compute.manager [req-409eefea-3fc4-4ef4-9fba-97a9b19a9742 req-a4b6a80e-a9ef-4527-a7ff-9814c29b2e28 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received unexpected event network-vif-plugged-15e598ed-6d82-4978-9ea7-57da256807b3 for instance with vm_state active and task_state None.
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:711ec528-9d10-4441-99fd-7bd08c524292 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b6986b-4ddb-48c7-bb28-c4a48167243a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] <== disconnect_volume: return (396ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:11:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 284164096 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 417333248 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:27 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'flavor' on Instance uuid 1d0bc5da-ed98-417a-9fc1-1f636887f035 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8dc81490-e215-42a5-8250-58af9560a4fd tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.713s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 563085312 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 732954624 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 898629632 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 1030750208 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvyPecQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:30 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbdea48-b612-4b17-9108-7fca727399d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:11:30 user nova-compute[71482]: No targets found.
Apr 12 09:11:30 user nova-compute[71482]: iSNS:
Apr 12 09:11:30 user nova-compute[71482]: No targets found.
Apr 12 09:11:30 user nova-compute[71482]: STATIC:
Apr 12 09:11:30 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320
Apr 12 09:11:30 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:30 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:30 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a
Apr 12 09:11:30 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:30 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:30 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:11:30 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:30 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:30 user nova-compute[71482]: FIRMWARE:
Apr 12 09:11:30 user nova-compute[71482]: No targets found.
Apr 12 09:11:30 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:11:30 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:11:30 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1262cba6-b64e-4c9c-a0d2-5e128b6a8bb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3830985a-caf1-4f57-a4b8-5df2f66e5041]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:30 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:30 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:30 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:30 user nova-compute[71482]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:30 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:30 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f93444bf9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dcac29-d189-4529-be5d-7c62a42d9b5e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a49ba8-2618-4851-9fa8-6a756b43e085]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[610dc783-8275-4fc1-b7be-e048cc8d5c70]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b7ff97-ea54-484c-9130-25042a62d3a4]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c981c5b2-6965-4926-97b2-a336fca2ddd6]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[495860be-ae09-4f10-8eb7-e17c30d3ad21]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260]
Apr 12 09:11:30 user nova-compute[71482]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:30 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c517e1c-166f-431a-8459-36cb0143e0f3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] <== disconnect_volume: return (303ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqNvPSFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '94f40323-58a6-4e9c-b26b-23615dde13d3', 'attached_at': '', 'detached_at': '', 'volume_id': '8efa7873-7011-4a2d-9e41-54b8ed92441a', 'serial'} {{(pid=71482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 09:11:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] swap_volume: removing Cinder connection for volume 297e37c3-cfa1-4064-98b5-4565c088c320 {{(pid=71482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 09:11:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] swap_volume: Updating volume 297e37c3-cfa1-4064-98b5-4565c088c320 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "sqNvPSFC", "auth_password": "O0w35I4xldSDnt", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "8efa7873-7011-4a2d-9e41-54b8ed92441a"}, "status": "reserved", "instance": "94f40323-58a6-4e9c-b26b-23615dde13d3", "attached_at": "", "detached_at": "", "volume_id": "8efa7873-7011-4a2d-9e41-54b8ed92441a", "serial": "8efa7873-7011-4a2d-9e41-54b8ed92441a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '8efa7873-7011-4a2d-9e41-54b8ed92441a', 'no_device': None, 'attachment_id': '00beb842-035b-4ec5-99fd-14b918177a79'} {{(pid=71482) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 09:11:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d65c25b-0299-46e3-a69f-79c17b160115 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.860s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:31 user nova-compute[71482]: DEBUG os_brick.utils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[da681492-296d-4d01-984f-377196b27636]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0556d9e2-ca20-4dfa-b57d-7e9cdc9f1d2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bdb439-3591-48a1-82f3-4a1bfa7304cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[363796cc-4f53-40a4-839b-0f552109a7b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:32 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:11:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bcce0c-ef7d-4827-9c8f-0a058005f1e6]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:11:32 user nova-compute[71482]: DEBUG os_brick.utils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:32 user nova-compute[71482]: INFO nova.compute.manager [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Swapping volume 8efa7873-7011-4a2d-9e41-54b8ed92441a for 297e37c3-cfa1-4064-98b5-4565c088c320
Apr 12 09:11:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUQJEWvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:33 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:33 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:33 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dca79ed-c405-4a9c-b1e7-8c516dabf05e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:11:33 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd02e22b-ecf7-4216-a98f-7a9de6d744f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630] added
Apr 12 09:11:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cffc41-f38d-40af-b3b2-cdf64b5a374b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca404e6-2a9c-4894-b9d4-ee2548fadb53]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUQJEWvc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IUQJEWvc" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc17725-40a1-40a2-8404-c98e670b8def]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IUQJEWvc'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a863c4e0-8caa-4755-9628-2394e757c058]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4f7fa7-9d84-48e6-9da4-6f562e6aae6a]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:33 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:33 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4184d2d-cc36-4dad-b3fa-ebe95d31edc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630, portal: 172.16.0.220,3260]
Apr 12 09:11:33 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c393b2-dbbd-4606-b109-32e326d96b68]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4db863-a210-4d4c-b611-d183f886f219]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:33 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:33 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:33 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:33 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cb39ec-5e14-49b5-ae7c-e87a1a67f8c3]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:11:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUQJEWvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSuavjUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:34 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23565356438313534', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565356438313534', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.012s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:34 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:34 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lazy-loading 'flavor' on Instance uuid 22eabe74-0932-472e-8090-09e8431f4f4a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0493c527-9591-4850-ba66-9f5d70ec4345]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:11:34 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:11:34 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:34 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:11:34 user nova-compute[71482]:   <target dev="sdc" bus="scsi"/>
Apr 12 09:11:34 user nova-compute[71482]:   <serial>0e4efab7-f288-474b-8263-3dd11305b630</serial>
Apr 12 09:11:34 user nova-compute[71482]:   <address type="drive" controller="0" unit="2"/>
Apr 12 09:11:34 user nova-compute[71482]: </disk>
Apr 12 09:11:34 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb22e34b-b3d7-475d-b17f-f9c50c09ef76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da] added
Apr 12 09:11:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd1947e-ae00-4bc1-9669-556625d609aa]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df58a1c-32c9-45d7-a3f4-1360fab6b747]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSuavjUF {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSuavjUF" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07a791a-4764-4ff3-91ee-a0a984c31279]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tSuavjUF'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1354694b-93ea-4345-a1c4-49b5663849d5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[da09acc5-cc60-4684-b11f-2813be2e322e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f873d7-6627-45cd-832e-a78e3e17319a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da, portal: 172.16.0.220,3260]
Apr 12 09:11:34 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72b0f8e-2fd8-4a86-854b-ac0ed21df73c]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03794525-bd96-460d-832b-4c086202ace2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:34 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c8e87a-ca06-42eb-aeea-32fe5bdeccd1]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSuavjUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] No BDM found with device name sda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] No VIF found with MAC fa:16:3e:34:22:e5, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8ad75ffe-fed4-44b0-8c72-2a9f6dc007aa tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.358s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received event network-changed-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Refreshing instance network info cache due to event network-changed-60f2af8d-b456-4efe-b146-cc700b68733e. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] Acquiring lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] Acquired lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Refreshing network info cache for port 60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'flavor' on Instance uuid a5e42339-50fa-411c-94a1-c350727b7955 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23830363438303761', 'path': '/dev/sdd'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830363438303761', 'path': '/dev/sdd'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'flavor' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:11:35 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:35 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:11:35 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:35 user nova-compute[71482]:   <serial>e4807592-9afe-402c-b7b4-68ce06c585da</serial>
Apr 12 09:11:35 user nova-compute[71482]: </disk>
Apr 12 09:11:35 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:35 user nova-compute[71482]: INFO nova.compute.manager [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Detaching volume 0e4efab7-f288-474b-8263-3dd11305b630
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:35 user nova-compute[71482]: INFO nova.compute.manager [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Attaching volume 4531b054-1af7-4630-8d73-8f1bac8a7723 to /dev/vdb
Apr 12 09:11:35 user nova-compute[71482]: INFO nova.virt.block_device [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Attempting to driver detach volume 0e4efab7-f288-474b-8263-3dd11305b630 from mountpoint /dev/sdc
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Attempting to detach device sdc from instance 22eabe74-0932-472e-8090-09e8431f4f4a from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:36 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:36 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:11:36 user nova-compute[71482]:   <target dev="sdc" bus="scsi"/>
Apr 12 09:11:36 user nova-compute[71482]:   <serial>0e4efab7-f288-474b-8263-3dd11305b630</serial>
Apr 12 09:11:36 user nova-compute[71482]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 09:11:36 user nova-compute[71482]: </disk>
Apr 12 09:11:36 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Successfully detached device sdc from instance 22eabe74-0932-472e-8090-09e8431f4f4a from the persistent domain config.
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 22eabe74-0932-472e-8090-09e8431f4f4a from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:36 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:36 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:11:36 user nova-compute[71482]:   <target dev="sdc" bus="scsi"/>
Apr 12 09:11:36 user nova-compute[71482]:   <serial>0e4efab7-f288-474b-8263-3dd11305b630</serial>
Apr 12 09:11:36 user nova-compute[71482]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 12 09:11:36 user nova-compute[71482]: </disk>
Apr 12 09:11:36 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.utils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd9f2b6-e216-4484-b3ed-7fed08982c90]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf1cc43-836a-4a85-9160-c57d8d61c866]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcedf7c6-687a-41fe-8826-ecdd2a1b9132]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91dde90-ce0b-402c-9c10-2b1bc31f185a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updated VIF entry in instance network info cache for port 60f2af8d-b456-4efe-b146-cc700b68733e. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updating instance_info_cache with network_info: [{"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-36f0ce8e-a0c5-4521-ae70-e7def84e7653 req-d1f0c9c0-4fd7-4881-abcb-3bd724669569 service nova] Releasing lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:36 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[43daa97d-7267-4318-803b-d1977d635dd6]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.utils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updating existing volume attachment record: 65fde146-162f-4a95-8043-95c94ed3f983 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] No BDM found with device name hda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] No VIF found with MAC fa:16:3e:3d:0e:e4, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.compute.manager [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvyPecQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94f40323-58a6-4e9c-b26b-23615dde13d3', 'attached_at': '', 'detached_at': '', 'volume_id': '297e37c3-cfa1-4064-98b5-4565c088c320', 'serial': '297e37c3-cfa1-4064-98b5-4565c088c320'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqNvPSFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '8efa7873-7011-4a2d-9e41-54b8ed92441a'}, 'status': 'reserved', 'instance': '94f40323-58a6-4e9c-b26b-23615dde13d3', 'attached_at': '', 'detached_at': '', 'volume_id': '8efa7873-7011-4a2d-9e41-54b8ed92441a', 'serial'} {{(pid=71482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvyPecQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:36 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:36 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:36 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8dc02760-3978-4725-88c8-480bacfe01b7 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.633s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee657832-4116-4b35-bf09-851e3b948896]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:11:36 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e4b963-3b4e-4ff5-9f74-7bd0613b3960]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320] added
Apr 12 09:11:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2117df09-a095-4b1c-982c-0426c62c0aa5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681290696.549522, 22eabe74-0932-472e-8090-09e8431f4f4a => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 22eabe74-0932-472e-8090-09e8431f4f4a {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:11:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Successfully detached device sdc from instance 22eabe74-0932-472e-8090-09e8431f4f4a from the live domain config.
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6519e890-64b4-456b-a5b3-144e471e1ee1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IUQJEWvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:36 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvyPecQB {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NvyPecQB" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a0ce10-915b-4492-bb35-1b600ee72151]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NvyPecQB'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60a1919-d2d1-4139-b690-b28dc915a357]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e3a3bd-79b3-4927-9a16-837b923bf3cc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[544945f0-e9a9-434a-ac21-e86f51a9fad4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260]
Apr 12 09:11:36 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcac677a-74cf-46ac-9da7-56595bc57ed9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2048435a-4120-459a-9469-3bd53ea3f483]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:36 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b70697d-d933-4357-9593-94b91e8db2ed]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:11:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvyPecQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:37 user nova-compute[71482]: INFO nova.compute.manager [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Detaching volume e4807592-9afe-402c-b7b4-68ce06c585da
Apr 12 09:11:37 user nova-compute[71482]: INFO nova.virt.block_device [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Attempting to driver detach volume e4807592-9afe-402c-b7b4-68ce06c585da from mountpoint /dev/vdb
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Attempting to detach device vdb from instance fbbb84fb-1d35-4249-8c8a-d9a02176243c from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:37 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:37 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:11:37 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:37 user nova-compute[71482]:   <serial>e4807592-9afe-402c-b7b4-68ce06c585da</serial>
Apr 12 09:11:37 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 09:11:37 user nova-compute[71482]: </disk>
Apr 12 09:11:37 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Successfully detached device vdb from instance fbbb84fb-1d35-4249-8c8a-d9a02176243c from the persistent domain config.
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fbbb84fb-1d35-4249-8c8a-d9a02176243c from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:37 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:37 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:11:37 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:37 user nova-compute[71482]:   <serial>e4807592-9afe-402c-b7b4-68ce06c585da</serial>
Apr 12 09:11:37 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 09:11:37 user nova-compute[71482]: </disk>
Apr 12 09:11:37 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:11:37 user nova-compute[71482]: INFO nova.compute.claims [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Claim successful on node user
Apr 12 09:11:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26463313333343235', 'path': '/dev/sdf'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313333343235', 'path': '/dev/sdf'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681290697.8039777, fbbb84fb-1d35-4249-8c8a-d9a02176243c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.240s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Successfully detached device vdb from instance fbbb84fb-1d35-4249-8c8a-d9a02176243c from the live domain config.
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lazy-loading 'flavor' on Instance uuid 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSuavjUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:37 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[174301e2-520a-4ff1-a60a-5b7809750ea0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:11:37 user nova-compute[71482]: No targets found.
Apr 12 09:11:37 user nova-compute[71482]: iSNS:
Apr 12 09:11:37 user nova-compute[71482]: No targets found.
Apr 12 09:11:37 user nova-compute[71482]: STATIC:
Apr 12 09:11:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320
Apr 12 09:11:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da
Apr 12 09:11:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630
Apr 12 09:11:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a
Apr 12 09:11:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:11:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:37 user nova-compute[71482]: FIRMWARE:
Apr 12 09:11:37 user nova-compute[71482]: No targets found.
Apr 12 09:11:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:11:37 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:11:37 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[840a22ca-8ce1-4efe-896c-d7a1447dc3a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177a9d4-e4f9-4417-9b10-d32d6db343d6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:37 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:37 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:37 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:37 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:37 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:37 user nova-compute[71482]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 (non-flash)
Apr 12 09:11:37 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:37 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f93441b0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1b2cfb-5853-41f4-8ac1-0edebb193580]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cbbec9-1d1e-4f4a-beca-88cf190dddaf]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd1cb7a-37ff-4dac-845a-8fed95d4195b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1565d95b-79d8-45e5-99de-3af6cd56bc10]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c4c6ef-e211-4e4f-9202-09765f662b3a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[40351842-4214-4cee-9ea3-c25d6097c1d7]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630, portal: 172.16.0.220,3260]
Apr 12 09:11:38 user nova-compute[71482]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:11:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e4efab7-f288-474b-8263-3dd11305b630 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbb9909-faf0-4e41-a795-10c7bb2d2a26]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] <== disconnect_volume: return (1575ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.327s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb9d6d0-7293-479d-a77c-9faca3429502]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:11:38 user nova-compute[71482]: No targets found.
Apr 12 09:11:38 user nova-compute[71482]: iSNS:
Apr 12 09:11:38 user nova-compute[71482]: No targets found.
Apr 12 09:11:38 user nova-compute[71482]: STATIC:
Apr 12 09:11:38 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320
Apr 12 09:11:38 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:38 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:38 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da
Apr 12 09:11:38 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:38 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:38 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a
Apr 12 09:11:38 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:38 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:38 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:11:38 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:38 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:38 user nova-compute[71482]: FIRMWARE:
Apr 12 09:11:38 user nova-compute[71482]: No targets found.
Apr 12 09:11:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:11:38 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:11:38 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[69456b8f-bb2e-42c8-9db8-dfd7e1c082a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: INFO nova.virt.block_device [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Booting with blank volume at /dev/vda
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[164581b3-19f7-4af0-b3a3-4085890d4705]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:38 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:38 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:38 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:38 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:38 user nova-compute[71482]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da (non-flash)
Apr 12 09:11:38 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9349b829e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da'): ({'sdd'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Removing single pathed devices sdd {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.policy [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5242afcc-5896-4fa1-a9b1-cade52e1fe8a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b9b7ed-0655-4638-a695-fe6b434c0107]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Flushing IO for device /dev/sdd {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[609ee100-2faf-40f8-af5d-72ae4dc14c4d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e96b7a8-368a-43cc-ae33-ebd4c8f4142e]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d806e5-6228-41e6-8cf8-dc2ba2efc12f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f856d0-a3c9-461a-836d-624882afc33d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da, portal: 172.16.0.220,3260]
Apr 12 09:11:38 user nova-compute[71482]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e4807592-9afe-402c-b7b4-68ce06c585da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[95411293-5f58-4935-9ea6-a9fdd55fac41]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] <== disconnect_volume: return (685ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:11:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 97517568 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Successfully created port: 2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:11:39 user nova-compute[71482]: DEBUG nova.objects.instance [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lazy-loading 'flavor' on Instance uuid 22eabe74-0932-472e-8090-09e8431f4f4a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-06549953-a7eb-4652-a80c-b880663a88c0 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.384s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 226492416 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 347078656 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:40 user nova-compute[71482]: INFO nova.compute.manager [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Terminating instance
Apr 12 09:11:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG nova.objects.instance [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'flavor' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ad1f2a28-976e-484e-b27c-8da1a3e748d6 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.009s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 469762048 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received event network-vif-unplugged-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] No waiting events found dispatching network-vif-unplugged-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-9d80285b-e049-4a7b-ae28-3b79a60bdd11 req-57165602-c0e9-407d-bb56-e5091908beaa service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received event network-vif-unplugged-f3af3839-bbd2-4152-ab34-91c767220af4 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 592445440 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "interface-fbbb84fb-1d35-4249-8c8a-d9a02176243c-15e598ed-6d82-4978-9ea7-57da256807b3" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "interface-fbbb84fb-1d35-4249-8c8a-d9a02176243c-15e598ed-6d82-4978-9ea7-57da256807b3" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Instance destroyed successfully.
Apr 12 09:11:40 user nova-compute[71482]: DEBUG nova.objects.instance [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lazy-loading 'resources' on Instance uuid 22eabe74-0932-472e-8090-09e8431f4f4a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.objects.instance [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'flavor' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1504382156',display_name='tempest-AttachSCSIVolumeTestJSON-server-1504382156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1504382156',id=10,image_ref='bcda072a-5430-47b7-b2b3-b29e054883ad',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAhIEvy6u0ucraKFLAKUfRFmPWc1THTzkE+nKz5trKmDMVoQY5PQec7o8K/gFwTTmFODGDbFv4P9xU/YGnuWeTKYMN0cg2aCVtGTel1KJX/H1uLY/x5ICkLJGSItgbH6bQ==',key_name='tempest-keypair-1729758921',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c5768be2d4a446f4ac473502a0b909dc',ramdisk_id='',reservation_id='r-m58u8dj0',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcda072a-5430-47b7-b2b3-b29e054883ad',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-580617659',owner_user_name='tempest-AttachSCSIVolumeTestJSON-580617659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ac61f1cb87d4ed5a488b2cff4a63375',uuid=22eabe74-0932-472e-8090-09e8431f4f4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Converting VIF {"id": "f3af3839-bbd2-4152-ab34-91c767220af4", "address": "fa:16:3e:34:22:e5", "network": {"id": "de15a39b-b186-4f7a-a0e1-40e8dad38f96", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-120829398-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c5768be2d4a446f4ac473502a0b909dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3af3839-bb", "ovs_interfaceid": "f3af3839-bbd2-4152-ab34-91c767220af4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:22:e5,bridge_name='br-int',has_traffic_filtering=True,id=f3af3839-bbd2-4152-ab34-91c767220af4,network=Network(de15a39b-b186-4f7a-a0e1-40e8dad38f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af3839-bb') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_vif [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:22:e5,bridge_name='br-int',has_traffic_filtering=True,id=f3af3839-bbd2-4152-ab34-91c767220af4,network=Network(de15a39b-b186-4f7a-a0e1-40e8dad38f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af3839-bb') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3af3839-bb, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:41 user nova-compute[71482]: INFO os_vif [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:22:e5,bridge_name='br-int',has_traffic_filtering=True,id=f3af3839-bbd2-4152-ab34-91c767220af4,network=Network(de15a39b-b186-4f7a-a0e1-40e8dad38f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3af3839-bb')
Apr 12 09:11:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Deleting instance files /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a_del
Apr 12 09:11:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Deletion of /opt/stack/data/nova/instances/22eabe74-0932-472e-8090-09e8431f4f4a_del complete
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091699595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2091699595',id=9,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ==',key_name='tempest-keypair-591560650',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed443186516c4075ab14a4b0be130e31',ramdisk_id='',reservation_id='r-zd9zb9ej',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1337552011',owner_user_name='tempest-TaggedAttachmentsTest-1337552011-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc97c54107de479bade4014982d79287',uuid=fbbb84fb-1d35-4249-8c8a-d9a02176243c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converting VIF {"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface> {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface> {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Attempting to detach device tap15e598ed-6d from instance fbbb84fb-1d35-4249-8c8a-d9a02176243c from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] detach device xml: <interface type="ethernet">
Apr 12 09:11:41 user nova-compute[71482]:   <mac address="fa:16:3e:fa:4e:39"/>
Apr 12 09:11:41 user nova-compute[71482]:   <model type="virtio"/>
Apr 12 09:11:41 user nova-compute[71482]:   <mtu size="1442"/>
Apr 12 09:11:41 user nova-compute[71482]:   <target dev="tap15e598ed-6d"/>
Apr 12 09:11:41 user nova-compute[71482]: </interface>
Apr 12 09:11:41 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface> {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 12 09:11:41 user nova-compute[71482]:   <name>instance-00000009</name>
Apr 12 09:11:41 user nova-compute[71482]:   <uuid>fbbb84fb-1d35-4249-8c8a-d9a02176243c</uuid>
Apr 12 09:11:41 user nova-compute[71482]:   <metadata>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:11:41 user nova-compute[71482]:   <nova:package version="0.0.0"/>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:name>tempest-device-tagging-server-2091699595</nova:name>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:creationTime>2023-04-12 09:11:24</nova:creationTime>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:flavor name="m1.nano">
Apr 12 09:11:41 user nova-compute[71482]:     <nova:memory>128</nova:memory>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:disk>1</nova:disk>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:swap>0</nova:swap>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:vcpus>1</nova:vcpus>
Apr 12 09:11:41 user nova-compute[71482]:   </nova:flavor>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:owner>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:user uuid="bc97c54107de479bade4014982d79287">tempest-TaggedAttachmentsTest-1337552011-project-member</nova:user>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:project uuid="ed443186516c4075ab14a4b0be130e31">tempest-TaggedAttachmentsTest-1337552011</nova:project>
Apr 12 09:11:41 user nova-compute[71482]:   </nova:owner>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:ports>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:port uuid="c7ccda6d-74db-4747-a5eb-dba5e82506fa">
Apr 12 09:11:41 user nova-compute[71482]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:11:41 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:port uuid="15e598ed-6d82-4978-9ea7-57da256807b3">
Apr 12 09:11:41 user nova-compute[71482]:       <nova:ip type="fixed" address="10.10.10.144" ipVersion="4"/>
Apr 12 09:11:41 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:41 user nova-compute[71482]:   </nova:ports>
Apr 12 09:11:41 user nova-compute[71482]: </nova:instance>
Apr 12 09:11:41 user nova-compute[71482]:   </metadata>
Apr 12 09:11:41 user nova-compute[71482]:   <memory unit='KiB'>131072</memory>
Apr 12 09:11:41 user nova-compute[71482]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 09:11:41 user nova-compute[71482]:   <vcpu placement='static'>1</vcpu>
Apr 12 09:11:41 user nova-compute[71482]:   <resource>
Apr 12 09:11:41 user nova-compute[71482]:     <partition>/machine</partition>
Apr 12 09:11:41 user nova-compute[71482]:   </resource>
Apr 12 09:11:41 user nova-compute[71482]:   <sysinfo type='smbios'>
Apr 12 09:11:41 user nova-compute[71482]:     <system>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='version'>0.0.0</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='serial'>fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='uuid'>fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='family'>Virtual Machine</entry>
Apr 12 09:11:41 user nova-compute[71482]:     </system>
Apr 12 09:11:41 user nova-compute[71482]:   </sysinfo>
Apr 12 09:11:41 user nova-compute[71482]:   <os>
Apr 12 09:11:41 user nova-compute[71482]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 09:11:41 user nova-compute[71482]:     <boot dev='hd'/>
Apr 12 09:11:41 user nova-compute[71482]:     <smbios mode='sysinfo'/>
Apr 12 09:11:41 user nova-compute[71482]:   </os>
Apr 12 09:11:41 user nova-compute[71482]:   <features>
Apr 12 09:11:41 user nova-compute[71482]:     <acpi/>
Apr 12 09:11:41 user nova-compute[71482]:     <apic/>
Apr 12 09:11:41 user nova-compute[71482]:     <vmcoreinfo state='on'/>
Apr 12 09:11:41 user nova-compute[71482]:   </features>
Apr 12 09:11:41 user nova-compute[71482]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 09:11:41 user nova-compute[71482]:     <model fallback='forbid'>Nehalem</model>
Apr 12 09:11:41 user nova-compute[71482]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 09:11:41 user nova-compute[71482]:     <feature policy='require' name='vme'/>
Apr 12 09:11:41 user nova-compute[71482]:     <feature policy='require' name='x2apic'/>
Apr 12 09:11:41 user nova-compute[71482]:     <feature policy='require' name='hypervisor'/>
Apr 12 09:11:41 user nova-compute[71482]:   </cpu>
Apr 12 09:11:41 user nova-compute[71482]:   <clock offset='utc'>
Apr 12 09:11:41 user nova-compute[71482]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 09:11:41 user nova-compute[71482]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 09:11:41 user nova-compute[71482]:     <timer name='hpet' present='no'/>
Apr 12 09:11:41 user nova-compute[71482]:   </clock>
Apr 12 09:11:41 user nova-compute[71482]:   <on_poweroff>destroy</on_poweroff>
Apr 12 09:11:41 user nova-compute[71482]:   <on_reboot>restart</on_reboot>
Apr 12 09:11:41 user nova-compute[71482]:   <on_crash>destroy</on_crash>
Apr 12 09:11:41 user nova-compute[71482]:   <devices>
Apr 12 09:11:41 user nova-compute[71482]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 09:11:41 user nova-compute[71482]:     <disk type='file' device='disk'>
Apr 12 09:11:41 user nova-compute[71482]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 09:11:41 user nova-compute[71482]:       <source file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk' index='2'/>
Apr 12 09:11:41 user nova-compute[71482]:       <backingStore type='file' index='3'>
Apr 12 09:11:41 user nova-compute[71482]:         <format type='raw'/>
Apr 12 09:11:41 user nova-compute[71482]:         <source file='/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609'/>
Apr 12 09:11:41 user nova-compute[71482]:         <backingStore/>
Apr 12 09:11:41 user nova-compute[71482]:       </backingStore>
Apr 12 09:11:41 user nova-compute[71482]:       <target dev='vda' bus='virtio'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='virtio-disk0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </disk>
Apr 12 09:11:41 user nova-compute[71482]:     <disk type='file' device='cdrom'>
Apr 12 09:11:41 user nova-compute[71482]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 09:11:41 user nova-compute[71482]:       <source file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.config' index='1'/>
Apr 12 09:11:41 user nova-compute[71482]:       <backingStore/>
Apr 12 09:11:41 user nova-compute[71482]:       <target dev='hda' bus='ide'/>
Apr 12 09:11:41 user nova-compute[71482]:       <readonly/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='ide0-0-0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </disk>
Apr 12 09:11:41 user nova-compute[71482]:     <controller type='usb' index='0' model='none'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='usb'/>
Apr 12 09:11:41 user nova-compute[71482]:     </controller>
Apr 12 09:11:41 user nova-compute[71482]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='pci.0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </controller>
Apr 12 09:11:41 user nova-compute[71482]:     <controller type='ide' index='0'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='ide'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 09:11:41 user nova-compute[71482]:     </controller>
Apr 12 09:11:41 user nova-compute[71482]:     <interface type='ethernet'>
Apr 12 09:11:41 user nova-compute[71482]:       <mac address='fa:16:3e:3d:0e:e4'/>
Apr 12 09:11:41 user nova-compute[71482]:       <target dev='tapc7ccda6d-74'/>
Apr 12 09:11:41 user nova-compute[71482]:       <model type='virtio'/>
Apr 12 09:11:41 user nova-compute[71482]:       <mtu size='1442'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='net0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </interface>
Apr 12 09:11:41 user nova-compute[71482]:     <interface type='ethernet'>
Apr 12 09:11:41 user nova-compute[71482]:       <mac address='fa:16:3e:fa:4e:39'/>
Apr 12 09:11:41 user nova-compute[71482]:       <target dev='tap15e598ed-6d'/>
Apr 12 09:11:41 user nova-compute[71482]:       <model type='virtio'/>
Apr 12 09:11:41 user nova-compute[71482]:       <mtu size='1442'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='net1'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </interface>
Apr 12 09:11:41 user nova-compute[71482]:     <serial type='pty'>
Apr 12 09:11:41 user nova-compute[71482]:       <source path='/dev/pts/8'/>
Apr 12 09:11:41 user nova-compute[71482]:       <log file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log' append='off'/>
Apr 12 09:11:41 user nova-compute[71482]:       <target type='isa-serial' port='0'>
Apr 12 09:11:41 user nova-compute[71482]:         <model name='isa-serial'/>
Apr 12 09:11:41 user nova-compute[71482]:       </target>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='serial0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </serial>
Apr 12 09:11:41 user nova-compute[71482]:     <console type='pty' tty='/dev/pts/8'>
Apr 12 09:11:41 user nova-compute[71482]:       <source path='/dev/pts/8'/>
Apr 12 09:11:41 user nova-compute[71482]:       <log file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log' append='off'/>
Apr 12 09:11:41 user nova-compute[71482]:       <target type='serial' port='0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='serial0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </console>
Apr 12 09:11:41 user nova-compute[71482]:     <input type='mouse' bus='ps2'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='input0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </input>
Apr 12 09:11:41 user nova-compute[71482]:     <input type='keyboard' bus='ps2'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='input1'/>
Apr 12 09:11:41 user nova-compute[71482]:     </input>
Apr 12 09:11:41 user nova-compute[71482]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 12 09:11:41 user nova-compute[71482]:       <listen type='address' address='0.0.0.0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </graphics>
Apr 12 09:11:41 user nova-compute[71482]:     <audio id='1' type='none'/>
Apr 12 09:11:41 user nova-compute[71482]:     <video>
Apr 12 09:11:41 user nova-compute[71482]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='video0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </video>
Apr 12 09:11:41 user nova-compute[71482]:     <memballoon model='virtio'>
Apr 12 09:11:41 user nova-compute[71482]:       <stats period='10'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='balloon0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </memballoon>
Apr 12 09:11:41 user nova-compute[71482]:     <rng model='virtio'>
Apr 12 09:11:41 user nova-compute[71482]:       <backend model='random'>/dev/urandom</backend>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='rng0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </rng>
Apr 12 09:11:41 user nova-compute[71482]:   </devices>
Apr 12 09:11:41 user nova-compute[71482]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 09:11:41 user nova-compute[71482]:     <label>libvirt-fbbb84fb-1d35-4249-8c8a-d9a02176243c</label>
Apr 12 09:11:41 user nova-compute[71482]:     <imagelabel>libvirt-fbbb84fb-1d35-4249-8c8a-d9a02176243c</imagelabel>
Apr 12 09:11:41 user nova-compute[71482]:   </seclabel>
Apr 12 09:11:41 user nova-compute[71482]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 09:11:41 user nova-compute[71482]:     <label>+64055:+108</label>
Apr 12 09:11:41 user nova-compute[71482]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 09:11:41 user nova-compute[71482]:   </seclabel>
Apr 12 09:11:41 user nova-compute[71482]: </domain>
Apr 12 09:11:41 user nova-compute[71482]:  {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 09:11:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Successfully detached device tap15e598ed-6d from instance fbbb84fb-1d35-4249-8c8a-d9a02176243c from the persistent domain config.
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] (1/8): Attempting to detach device tap15e598ed-6d with device alias net1 from instance fbbb84fb-1d35-4249-8c8a-d9a02176243c from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] detach device xml: <interface type="ethernet">
Apr 12 09:11:41 user nova-compute[71482]:   <mac address="fa:16:3e:fa:4e:39"/>
Apr 12 09:11:41 user nova-compute[71482]:   <model type="virtio"/>
Apr 12 09:11:41 user nova-compute[71482]:   <mtu size="1442"/>
Apr 12 09:11:41 user nova-compute[71482]:   <target dev="tap15e598ed-6d"/>
Apr 12 09:11:41 user nova-compute[71482]: </interface>
Apr 12 09:11:41 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:11:41 user nova-compute[71482]: INFO nova.compute.manager [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Took 1.01 seconds to destroy the instance on the hypervisor.
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Successfully updated port: 2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquired lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-changed-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Refreshing instance network info cache due to event network-changed-2c417659-5031-44dd-9796-062033960cc6. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] Acquiring lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 739246080 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681290701.3856637, fbbb84fb-1d35-4249-8c8a-d9a02176243c => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Start waiting for the detach event from libvirt for device tap15e598ed-6d with device alias net1 for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface> {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 12 09:11:41 user nova-compute[71482]:   <name>instance-00000009</name>
Apr 12 09:11:41 user nova-compute[71482]:   <uuid>fbbb84fb-1d35-4249-8c8a-d9a02176243c</uuid>
Apr 12 09:11:41 user nova-compute[71482]:   <metadata>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:11:41 user nova-compute[71482]:   <nova:package version="0.0.0"/>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:name>tempest-device-tagging-server-2091699595</nova:name>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:creationTime>2023-04-12 09:11:24</nova:creationTime>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:flavor name="m1.nano">
Apr 12 09:11:41 user nova-compute[71482]:     <nova:memory>128</nova:memory>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:disk>1</nova:disk>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:swap>0</nova:swap>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:vcpus>1</nova:vcpus>
Apr 12 09:11:41 user nova-compute[71482]:   </nova:flavor>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:owner>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:user uuid="bc97c54107de479bade4014982d79287">tempest-TaggedAttachmentsTest-1337552011-project-member</nova:user>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:project uuid="ed443186516c4075ab14a4b0be130e31">tempest-TaggedAttachmentsTest-1337552011</nova:project>
Apr 12 09:11:41 user nova-compute[71482]:   </nova:owner>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:ports>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:port uuid="c7ccda6d-74db-4747-a5eb-dba5e82506fa">
Apr 12 09:11:41 user nova-compute[71482]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:11:41 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:port uuid="15e598ed-6d82-4978-9ea7-57da256807b3">
Apr 12 09:11:41 user nova-compute[71482]:       <nova:ip type="fixed" address="10.10.10.144" ipVersion="4"/>
Apr 12 09:11:41 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:41 user nova-compute[71482]:   </nova:ports>
Apr 12 09:11:41 user nova-compute[71482]: </nova:instance>
Apr 12 09:11:41 user nova-compute[71482]:   </metadata>
Apr 12 09:11:41 user nova-compute[71482]:   <memory unit='KiB'>131072</memory>
Apr 12 09:11:41 user nova-compute[71482]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 09:11:41 user nova-compute[71482]:   <vcpu placement='static'>1</vcpu>
Apr 12 09:11:41 user nova-compute[71482]:   <resource>
Apr 12 09:11:41 user nova-compute[71482]:     <partition>/machine</partition>
Apr 12 09:11:41 user nova-compute[71482]:   </resource>
Apr 12 09:11:41 user nova-compute[71482]:   <sysinfo type='smbios'>
Apr 12 09:11:41 user nova-compute[71482]:     <system>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='version'>0.0.0</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='serial'>fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='uuid'>fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:11:41 user nova-compute[71482]:       <entry name='family'>Virtual Machine</entry>
Apr 12 09:11:41 user nova-compute[71482]:     </system>
Apr 12 09:11:41 user nova-compute[71482]:   </sysinfo>
Apr 12 09:11:41 user nova-compute[71482]:   <os>
Apr 12 09:11:41 user nova-compute[71482]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 09:11:41 user nova-compute[71482]:     <boot dev='hd'/>
Apr 12 09:11:41 user nova-compute[71482]:     <smbios mode='sysinfo'/>
Apr 12 09:11:41 user nova-compute[71482]:   </os>
Apr 12 09:11:41 user nova-compute[71482]:   <features>
Apr 12 09:11:41 user nova-compute[71482]:     <acpi/>
Apr 12 09:11:41 user nova-compute[71482]:     <apic/>
Apr 12 09:11:41 user nova-compute[71482]:     <vmcoreinfo state='on'/>
Apr 12 09:11:41 user nova-compute[71482]:   </features>
Apr 12 09:11:41 user nova-compute[71482]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 09:11:41 user nova-compute[71482]:     <model fallback='forbid'>Nehalem</model>
Apr 12 09:11:41 user nova-compute[71482]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 09:11:41 user nova-compute[71482]:     <feature policy='require' name='vme'/>
Apr 12 09:11:41 user nova-compute[71482]:     <feature policy='require' name='x2apic'/>
Apr 12 09:11:41 user nova-compute[71482]:     <feature policy='require' name='hypervisor'/>
Apr 12 09:11:41 user nova-compute[71482]:   </cpu>
Apr 12 09:11:41 user nova-compute[71482]:   <clock offset='utc'>
Apr 12 09:11:41 user nova-compute[71482]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 09:11:41 user nova-compute[71482]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 09:11:41 user nova-compute[71482]:     <timer name='hpet' present='no'/>
Apr 12 09:11:41 user nova-compute[71482]:   </clock>
Apr 12 09:11:41 user nova-compute[71482]:   <on_poweroff>destroy</on_poweroff>
Apr 12 09:11:41 user nova-compute[71482]:   <on_reboot>restart</on_reboot>
Apr 12 09:11:41 user nova-compute[71482]:   <on_crash>destroy</on_crash>
Apr 12 09:11:41 user nova-compute[71482]:   <devices>
Apr 12 09:11:41 user nova-compute[71482]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 09:11:41 user nova-compute[71482]:     <disk type='file' device='disk'>
Apr 12 09:11:41 user nova-compute[71482]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 09:11:41 user nova-compute[71482]:       <source file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk' index='2'/>
Apr 12 09:11:41 user nova-compute[71482]:       <backingStore type='file' index='3'>
Apr 12 09:11:41 user nova-compute[71482]:         <format type='raw'/>
Apr 12 09:11:41 user nova-compute[71482]:         <source file='/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609'/>
Apr 12 09:11:41 user nova-compute[71482]:         <backingStore/>
Apr 12 09:11:41 user nova-compute[71482]:       </backingStore>
Apr 12 09:11:41 user nova-compute[71482]:       <target dev='vda' bus='virtio'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='virtio-disk0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </disk>
Apr 12 09:11:41 user nova-compute[71482]:     <disk type='file' device='cdrom'>
Apr 12 09:11:41 user nova-compute[71482]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 09:11:41 user nova-compute[71482]:       <source file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.config' index='1'/>
Apr 12 09:11:41 user nova-compute[71482]:       <backingStore/>
Apr 12 09:11:41 user nova-compute[71482]:       <target dev='hda' bus='ide'/>
Apr 12 09:11:41 user nova-compute[71482]:       <readonly/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='ide0-0-0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </disk>
Apr 12 09:11:41 user nova-compute[71482]:     <controller type='usb' index='0' model='none'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='usb'/>
Apr 12 09:11:41 user nova-compute[71482]:     </controller>
Apr 12 09:11:41 user nova-compute[71482]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='pci.0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </controller>
Apr 12 09:11:41 user nova-compute[71482]:     <controller type='ide' index='0'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='ide'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 09:11:41 user nova-compute[71482]:     </controller>
Apr 12 09:11:41 user nova-compute[71482]:     <interface type='ethernet'>
Apr 12 09:11:41 user nova-compute[71482]:       <mac address='fa:16:3e:3d:0e:e4'/>
Apr 12 09:11:41 user nova-compute[71482]:       <target dev='tapc7ccda6d-74'/>
Apr 12 09:11:41 user nova-compute[71482]:       <model type='virtio'/>
Apr 12 09:11:41 user nova-compute[71482]:       <mtu size='1442'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='net0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </interface>
Apr 12 09:11:41 user nova-compute[71482]:     <serial type='pty'>
Apr 12 09:11:41 user nova-compute[71482]:       <source path='/dev/pts/8'/>
Apr 12 09:11:41 user nova-compute[71482]:       <log file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log' append='off'/>
Apr 12 09:11:41 user nova-compute[71482]:       <target type='isa-serial' port='0'>
Apr 12 09:11:41 user nova-compute[71482]:         <model name='isa-serial'/>
Apr 12 09:11:41 user nova-compute[71482]:       </target>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='serial0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </serial>
Apr 12 09:11:41 user nova-compute[71482]:     <console type='pty' tty='/dev/pts/8'>
Apr 12 09:11:41 user nova-compute[71482]:       <source path='/dev/pts/8'/>
Apr 12 09:11:41 user nova-compute[71482]:       <log file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log' append='off'/>
Apr 12 09:11:41 user nova-compute[71482]:       <target type='serial' port='0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='serial0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </console>
Apr 12 09:11:41 user nova-compute[71482]:     <input type='mouse' bus='ps2'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='input0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </input>
Apr 12 09:11:41 user nova-compute[71482]:     <input type='keyboard' bus='ps2'>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='input1'/>
Apr 12 09:11:41 user nova-compute[71482]:     </input>
Apr 12 09:11:41 user nova-compute[71482]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 12 09:11:41 user nova-compute[71482]:       <listen type='address' address='0.0.0.0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </graphics>
Apr 12 09:11:41 user nova-compute[71482]:     <audio id='1' type='none'/>
Apr 12 09:11:41 user nova-compute[71482]:     <video>
Apr 12 09:11:41 user nova-compute[71482]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='video0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </video>
Apr 12 09:11:41 user nova-compute[71482]:     <memballoon model='virtio'>
Apr 12 09:11:41 user nova-compute[71482]:       <stats period='10'/>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='balloon0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </memballoon>
Apr 12 09:11:41 user nova-compute[71482]:     <rng model='virtio'>
Apr 12 09:11:41 user nova-compute[71482]:       <backend model='random'>/dev/urandom</backend>
Apr 12 09:11:41 user nova-compute[71482]:       <alias name='rng0'/>
Apr 12 09:11:41 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 09:11:41 user nova-compute[71482]:     </rng>
Apr 12 09:11:41 user nova-compute[71482]:   </devices>
Apr 12 09:11:41 user nova-compute[71482]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 09:11:41 user nova-compute[71482]:     <label>libvirt-fbbb84fb-1d35-4249-8c8a-d9a02176243c</label>
Apr 12 09:11:41 user nova-compute[71482]:     <imagelabel>libvirt-fbbb84fb-1d35-4249-8c8a-d9a02176243c</imagelabel>
Apr 12 09:11:41 user nova-compute[71482]:   </seclabel>
Apr 12 09:11:41 user nova-compute[71482]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 09:11:41 user nova-compute[71482]:     <label>+64055:+108</label>
Apr 12 09:11:41 user nova-compute[71482]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 09:11:41 user nova-compute[71482]:   </seclabel>
Apr 12 09:11:41 user nova-compute[71482]: </domain>
Apr 12 09:11:41 user nova-compute[71482]:  {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 09:11:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Successfully detached device tap15e598ed-6d from instance fbbb84fb-1d35-4249-8c8a-d9a02176243c from the live domain config.
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091699595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2091699595',id=9,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ==',key_name='tempest-keypair-591560650',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed443186516c4075ab14a4b0be130e31',ramdisk_id='',reservation_id='r-zd9zb9ej',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1337552011',owner_user_name='tempest-TaggedAttachmentsTest-1337552011-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc97c54107de479bade4014982d79287',uuid=fbbb84fb-1d35-4249-8c8a-d9a02176243c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converting VIF {"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_vif [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e598ed-6d, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:41 user nova-compute[71482]: INFO os_vif [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d')
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:11:41 user nova-compute[71482]:   <nova:package version="0.0.0"/>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:name>tempest-device-tagging-server-2091699595</nova:name>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:creationTime>2023-04-12 09:11:41</nova:creationTime>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:flavor name="m1.nano">
Apr 12 09:11:41 user nova-compute[71482]:     <nova:memory>128</nova:memory>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:disk>1</nova:disk>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:swap>0</nova:swap>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:vcpus>1</nova:vcpus>
Apr 12 09:11:41 user nova-compute[71482]:   </nova:flavor>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:owner>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:user uuid="bc97c54107de479bade4014982d79287">tempest-TaggedAttachmentsTest-1337552011-project-member</nova:user>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:project uuid="ed443186516c4075ab14a4b0be130e31">tempest-TaggedAttachmentsTest-1337552011</nova:project>
Apr 12 09:11:41 user nova-compute[71482]:   </nova:owner>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:11:41 user nova-compute[71482]:   <nova:ports>
Apr 12 09:11:41 user nova-compute[71482]:     <nova:port uuid="c7ccda6d-74db-4747-a5eb-dba5e82506fa">
Apr 12 09:11:41 user nova-compute[71482]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:11:41 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:41 user nova-compute[71482]:   </nova:ports>
Apr 12 09:11:41 user nova-compute[71482]: </nova:instance>
Apr 12 09:11:41 user nova-compute[71482]:  {{(pid=71482) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcUeqNZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:41 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:41 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:41 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f75ada6-0b25-4d1a-8900-2450284036a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:11:41 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ee90de-aa2c-408c-a037-3b310083fcf1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723] added
Apr 12 09:11:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7546297-8028-4c14-9a0d-dec148a88510]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[517b9d17-7267-4719-8689-200b031b1a8a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcUeqNZT {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-unplugged-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] No waiting events found dispatching network-vif-unplugged-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:41 user nova-compute[71482]: WARNING nova.compute.manager [req-1acfe528-c94f-4da8-beeb-8116205859dd req-e42bb227-773c-4a0c-b12b-7063667267ed service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received unexpected event network-vif-unplugged-15e598ed-6d82-4978-9ea7-57da256807b3 for instance with vm_state active and task_state None.
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcUeqNZT" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7d98ac-2bde-4118-8501-72764cfb03ec]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IcUeqNZT'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[18779669-2c1a-48a0-a4e0-a89217a4fa6b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf7a89b-9b5f-4f0b-a9a2-146aace20c96]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9991d5d8-0b30-43fa-99b1-dca48e6a4613]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723, portal: 172.16.0.220,3260]
Apr 12 09:11:41 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ad2ac3-459a-4911-9a4b-cca06a6490b1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 872415232 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec407f-c22a-4b13-82f8-45faef786404]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:41 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8e4341-b5c0-407b-b90c-7edff831331b]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:11:41 user nova-compute[71482]: DEBUG nova.network.neutron [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updating instance_info_cache with network_info: [{"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Releasing lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Instance network_info: |[{"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] Acquired lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.neutron [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Refreshing network info cache for port 2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 1029701632 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquired lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.neutron [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received event network-vif-plugged-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Acquiring lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Lock "22eabe74-0932-472e-8090-09e8431f4f4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] No waiting events found dispatching network-vif-plugged-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:42 user nova-compute[71482]: WARNING nova.compute.manager [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received unexpected event network-vif-plugged-f3af3839-bbd2-4152-ab34-91c767220af4 for instance with vm_state active and task_state deleting.
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-deleted-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:42 user nova-compute[71482]: INFO nova.compute.manager [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Neutron deleted interface 15e598ed-6d82-4978-9ea7-57da256807b3; detaching it from the instance and deleting it from the info cache
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.neutron [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating instance_info_cache with network_info: [{"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.objects.instance [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Lazy-loading 'system_metadata' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.objects.instance [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Lazy-loading 'flavor' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091699595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2091699595',id=9,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ==',key_name='tempest-keypair-591560650',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed443186516c4075ab14a4b0be130e31',ramdisk_id='',reservation_id='r-zd9zb9ej',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1337552011',owner_user_name='tempest-TaggedAttachmentsTest-1337552011-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc97c54107de479bade4014982d79287',uuid=fbbb84fb-1d35-4249-8c8a-d9a02176243c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.os_vif_util [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Converting VIF {"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.os_vif_util [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface> {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 12 09:11:42 user nova-compute[71482]:   <name>instance-00000009</name>
Apr 12 09:11:42 user nova-compute[71482]:   <uuid>fbbb84fb-1d35-4249-8c8a-d9a02176243c</uuid>
Apr 12 09:11:42 user nova-compute[71482]:   <metadata>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:11:42 user nova-compute[71482]:   <nova:package version="0.0.0"/>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:name>tempest-device-tagging-server-2091699595</nova:name>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:creationTime>2023-04-12 09:11:41</nova:creationTime>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:flavor name="m1.nano">
Apr 12 09:11:42 user nova-compute[71482]:     <nova:memory>128</nova:memory>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:disk>1</nova:disk>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:swap>0</nova:swap>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:vcpus>1</nova:vcpus>
Apr 12 09:11:42 user nova-compute[71482]:   </nova:flavor>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:owner>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:user uuid="bc97c54107de479bade4014982d79287">tempest-TaggedAttachmentsTest-1337552011-project-member</nova:user>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:project uuid="ed443186516c4075ab14a4b0be130e31">tempest-TaggedAttachmentsTest-1337552011</nova:project>
Apr 12 09:11:42 user nova-compute[71482]:   </nova:owner>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:ports>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:port uuid="c7ccda6d-74db-4747-a5eb-dba5e82506fa">
Apr 12 09:11:42 user nova-compute[71482]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:11:42 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:42 user nova-compute[71482]:   </nova:ports>
Apr 12 09:11:42 user nova-compute[71482]: </nova:instance>
Apr 12 09:11:42 user nova-compute[71482]:   </metadata>
Apr 12 09:11:42 user nova-compute[71482]:   <memory unit='KiB'>131072</memory>
Apr 12 09:11:42 user nova-compute[71482]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 09:11:42 user nova-compute[71482]:   <vcpu placement='static'>1</vcpu>
Apr 12 09:11:42 user nova-compute[71482]:   <resource>
Apr 12 09:11:42 user nova-compute[71482]:     <partition>/machine</partition>
Apr 12 09:11:42 user nova-compute[71482]:   </resource>
Apr 12 09:11:42 user nova-compute[71482]:   <sysinfo type='smbios'>
Apr 12 09:11:42 user nova-compute[71482]:     <system>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='version'>0.0.0</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='serial'>fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='uuid'>fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='family'>Virtual Machine</entry>
Apr 12 09:11:42 user nova-compute[71482]:     </system>
Apr 12 09:11:42 user nova-compute[71482]:   </sysinfo>
Apr 12 09:11:42 user nova-compute[71482]:   <os>
Apr 12 09:11:42 user nova-compute[71482]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 09:11:42 user nova-compute[71482]:     <boot dev='hd'/>
Apr 12 09:11:42 user nova-compute[71482]:     <smbios mode='sysinfo'/>
Apr 12 09:11:42 user nova-compute[71482]:   </os>
Apr 12 09:11:42 user nova-compute[71482]:   <features>
Apr 12 09:11:42 user nova-compute[71482]:     <acpi/>
Apr 12 09:11:42 user nova-compute[71482]:     <apic/>
Apr 12 09:11:42 user nova-compute[71482]:     <vmcoreinfo state='on'/>
Apr 12 09:11:42 user nova-compute[71482]:   </features>
Apr 12 09:11:42 user nova-compute[71482]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 09:11:42 user nova-compute[71482]:     <model fallback='forbid'>Nehalem</model>
Apr 12 09:11:42 user nova-compute[71482]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 09:11:42 user nova-compute[71482]:     <feature policy='require' name='vme'/>
Apr 12 09:11:42 user nova-compute[71482]:     <feature policy='require' name='x2apic'/>
Apr 12 09:11:42 user nova-compute[71482]:     <feature policy='require' name='hypervisor'/>
Apr 12 09:11:42 user nova-compute[71482]:   </cpu>
Apr 12 09:11:42 user nova-compute[71482]:   <clock offset='utc'>
Apr 12 09:11:42 user nova-compute[71482]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 09:11:42 user nova-compute[71482]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 09:11:42 user nova-compute[71482]:     <timer name='hpet' present='no'/>
Apr 12 09:11:42 user nova-compute[71482]:   </clock>
Apr 12 09:11:42 user nova-compute[71482]:   <on_poweroff>destroy</on_poweroff>
Apr 12 09:11:42 user nova-compute[71482]:   <on_reboot>restart</on_reboot>
Apr 12 09:11:42 user nova-compute[71482]:   <on_crash>destroy</on_crash>
Apr 12 09:11:42 user nova-compute[71482]:   <devices>
Apr 12 09:11:42 user nova-compute[71482]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 09:11:42 user nova-compute[71482]:     <disk type='file' device='disk'>
Apr 12 09:11:42 user nova-compute[71482]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 09:11:42 user nova-compute[71482]:       <source file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk' index='2'/>
Apr 12 09:11:42 user nova-compute[71482]:       <backingStore type='file' index='3'>
Apr 12 09:11:42 user nova-compute[71482]:         <format type='raw'/>
Apr 12 09:11:42 user nova-compute[71482]:         <source file='/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609'/>
Apr 12 09:11:42 user nova-compute[71482]:         <backingStore/>
Apr 12 09:11:42 user nova-compute[71482]:       </backingStore>
Apr 12 09:11:42 user nova-compute[71482]:       <target dev='vda' bus='virtio'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='virtio-disk0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </disk>
Apr 12 09:11:42 user nova-compute[71482]:     <disk type='file' device='cdrom'>
Apr 12 09:11:42 user nova-compute[71482]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 09:11:42 user nova-compute[71482]:       <source file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.config' index='1'/>
Apr 12 09:11:42 user nova-compute[71482]:       <backingStore/>
Apr 12 09:11:42 user nova-compute[71482]:       <target dev='hda' bus='ide'/>
Apr 12 09:11:42 user nova-compute[71482]:       <readonly/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='ide0-0-0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </disk>
Apr 12 09:11:42 user nova-compute[71482]:     <controller type='usb' index='0' model='none'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='usb'/>
Apr 12 09:11:42 user nova-compute[71482]:     </controller>
Apr 12 09:11:42 user nova-compute[71482]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='pci.0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </controller>
Apr 12 09:11:42 user nova-compute[71482]:     <controller type='ide' index='0'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='ide'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 09:11:42 user nova-compute[71482]:     </controller>
Apr 12 09:11:42 user nova-compute[71482]:     <interface type='ethernet'>
Apr 12 09:11:42 user nova-compute[71482]:       <mac address='fa:16:3e:3d:0e:e4'/>
Apr 12 09:11:42 user nova-compute[71482]:       <target dev='tapc7ccda6d-74'/>
Apr 12 09:11:42 user nova-compute[71482]:       <model type='virtio'/>
Apr 12 09:11:42 user nova-compute[71482]:       <mtu size='1442'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='net0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </interface>
Apr 12 09:11:42 user nova-compute[71482]:     <serial type='pty'>
Apr 12 09:11:42 user nova-compute[71482]:       <source path='/dev/pts/8'/>
Apr 12 09:11:42 user nova-compute[71482]:       <log file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log' append='off'/>
Apr 12 09:11:42 user nova-compute[71482]:       <target type='isa-serial' port='0'>
Apr 12 09:11:42 user nova-compute[71482]:         <model name='isa-serial'/>
Apr 12 09:11:42 user nova-compute[71482]:       </target>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='serial0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </serial>
Apr 12 09:11:42 user nova-compute[71482]:     <console type='pty' tty='/dev/pts/8'>
Apr 12 09:11:42 user nova-compute[71482]:       <source path='/dev/pts/8'/>
Apr 12 09:11:42 user nova-compute[71482]:       <log file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log' append='off'/>
Apr 12 09:11:42 user nova-compute[71482]:       <target type='serial' port='0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='serial0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </console>
Apr 12 09:11:42 user nova-compute[71482]:     <input type='mouse' bus='ps2'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='input0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </input>
Apr 12 09:11:42 user nova-compute[71482]:     <input type='keyboard' bus='ps2'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='input1'/>
Apr 12 09:11:42 user nova-compute[71482]:     </input>
Apr 12 09:11:42 user nova-compute[71482]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 12 09:11:42 user nova-compute[71482]:       <listen type='address' address='0.0.0.0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </graphics>
Apr 12 09:11:42 user nova-compute[71482]:     <audio id='1' type='none'/>
Apr 12 09:11:42 user nova-compute[71482]:     <video>
Apr 12 09:11:42 user nova-compute[71482]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='video0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </video>
Apr 12 09:11:42 user nova-compute[71482]:     <memballoon model='virtio'>
Apr 12 09:11:42 user nova-compute[71482]:       <stats period='10'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='balloon0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </memballoon>
Apr 12 09:11:42 user nova-compute[71482]:     <rng model='virtio'>
Apr 12 09:11:42 user nova-compute[71482]:       <backend model='random'>/dev/urandom</backend>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='rng0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </rng>
Apr 12 09:11:42 user nova-compute[71482]:   </devices>
Apr 12 09:11:42 user nova-compute[71482]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 09:11:42 user nova-compute[71482]:     <label>libvirt-fbbb84fb-1d35-4249-8c8a-d9a02176243c</label>
Apr 12 09:11:42 user nova-compute[71482]:     <imagelabel>libvirt-fbbb84fb-1d35-4249-8c8a-d9a02176243c</imagelabel>
Apr 12 09:11:42 user nova-compute[71482]:   </seclabel>
Apr 12 09:11:42 user nova-compute[71482]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 09:11:42 user nova-compute[71482]:     <label>+64055:+108</label>
Apr 12 09:11:42 user nova-compute[71482]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 09:11:42 user nova-compute[71482]:   </seclabel>
Apr 12 09:11:42 user nova-compute[71482]: </domain>
Apr 12 09:11:42 user nova-compute[71482]:  {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface> {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:fa:4e:39"/><model type="virtio"/><mtu size="1442"/><target dev="tap15e598ed-6d"/></interface>not found in domain: <domain type='kvm' id='9'>
Apr 12 09:11:42 user nova-compute[71482]:   <name>instance-00000009</name>
Apr 12 09:11:42 user nova-compute[71482]:   <uuid>fbbb84fb-1d35-4249-8c8a-d9a02176243c</uuid>
Apr 12 09:11:42 user nova-compute[71482]:   <metadata>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:11:42 user nova-compute[71482]:   <nova:package version="0.0.0"/>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:name>tempest-device-tagging-server-2091699595</nova:name>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:creationTime>2023-04-12 09:11:41</nova:creationTime>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:flavor name="m1.nano">
Apr 12 09:11:42 user nova-compute[71482]:     <nova:memory>128</nova:memory>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:disk>1</nova:disk>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:swap>0</nova:swap>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:vcpus>1</nova:vcpus>
Apr 12 09:11:42 user nova-compute[71482]:   </nova:flavor>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:owner>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:user uuid="bc97c54107de479bade4014982d79287">tempest-TaggedAttachmentsTest-1337552011-project-member</nova:user>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:project uuid="ed443186516c4075ab14a4b0be130e31">tempest-TaggedAttachmentsTest-1337552011</nova:project>
Apr 12 09:11:42 user nova-compute[71482]:   </nova:owner>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:ports>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:port uuid="c7ccda6d-74db-4747-a5eb-dba5e82506fa">
Apr 12 09:11:42 user nova-compute[71482]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:11:42 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:42 user nova-compute[71482]:   </nova:ports>
Apr 12 09:11:42 user nova-compute[71482]: </nova:instance>
Apr 12 09:11:42 user nova-compute[71482]:   </metadata>
Apr 12 09:11:42 user nova-compute[71482]:   <memory unit='KiB'>131072</memory>
Apr 12 09:11:42 user nova-compute[71482]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 12 09:11:42 user nova-compute[71482]:   <vcpu placement='static'>1</vcpu>
Apr 12 09:11:42 user nova-compute[71482]:   <resource>
Apr 12 09:11:42 user nova-compute[71482]:     <partition>/machine</partition>
Apr 12 09:11:42 user nova-compute[71482]:   </resource>
Apr 12 09:11:42 user nova-compute[71482]:   <sysinfo type='smbios'>
Apr 12 09:11:42 user nova-compute[71482]:     <system>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='product'>OpenStack Nova</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='version'>0.0.0</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='serial'>fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='uuid'>fbbb84fb-1d35-4249-8c8a-d9a02176243c</entry>
Apr 12 09:11:42 user nova-compute[71482]:       <entry name='family'>Virtual Machine</entry>
Apr 12 09:11:42 user nova-compute[71482]:     </system>
Apr 12 09:11:42 user nova-compute[71482]:   </sysinfo>
Apr 12 09:11:42 user nova-compute[71482]:   <os>
Apr 12 09:11:42 user nova-compute[71482]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 12 09:11:42 user nova-compute[71482]:     <boot dev='hd'/>
Apr 12 09:11:42 user nova-compute[71482]:     <smbios mode='sysinfo'/>
Apr 12 09:11:42 user nova-compute[71482]:   </os>
Apr 12 09:11:42 user nova-compute[71482]:   <features>
Apr 12 09:11:42 user nova-compute[71482]:     <acpi/>
Apr 12 09:11:42 user nova-compute[71482]:     <apic/>
Apr 12 09:11:42 user nova-compute[71482]:     <vmcoreinfo state='on'/>
Apr 12 09:11:42 user nova-compute[71482]:   </features>
Apr 12 09:11:42 user nova-compute[71482]:   <cpu mode='custom' match='exact' check='full'>
Apr 12 09:11:42 user nova-compute[71482]:     <model fallback='forbid'>Nehalem</model>
Apr 12 09:11:42 user nova-compute[71482]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 12 09:11:42 user nova-compute[71482]:     <feature policy='require' name='vme'/>
Apr 12 09:11:42 user nova-compute[71482]:     <feature policy='require' name='x2apic'/>
Apr 12 09:11:42 user nova-compute[71482]:     <feature policy='require' name='hypervisor'/>
Apr 12 09:11:42 user nova-compute[71482]:   </cpu>
Apr 12 09:11:42 user nova-compute[71482]:   <clock offset='utc'>
Apr 12 09:11:42 user nova-compute[71482]:     <timer name='pit' tickpolicy='delay'/>
Apr 12 09:11:42 user nova-compute[71482]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 12 09:11:42 user nova-compute[71482]:     <timer name='hpet' present='no'/>
Apr 12 09:11:42 user nova-compute[71482]:   </clock>
Apr 12 09:11:42 user nova-compute[71482]:   <on_poweroff>destroy</on_poweroff>
Apr 12 09:11:42 user nova-compute[71482]:   <on_reboot>restart</on_reboot>
Apr 12 09:11:42 user nova-compute[71482]:   <on_crash>destroy</on_crash>
Apr 12 09:11:42 user nova-compute[71482]:   <devices>
Apr 12 09:11:42 user nova-compute[71482]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 12 09:11:42 user nova-compute[71482]:     <disk type='file' device='disk'>
Apr 12 09:11:42 user nova-compute[71482]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 12 09:11:42 user nova-compute[71482]:       <source file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk' index='2'/>
Apr 12 09:11:42 user nova-compute[71482]:       <backingStore type='file' index='3'>
Apr 12 09:11:42 user nova-compute[71482]:         <format type='raw'/>
Apr 12 09:11:42 user nova-compute[71482]:         <source file='/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609'/>
Apr 12 09:11:42 user nova-compute[71482]:         <backingStore/>
Apr 12 09:11:42 user nova-compute[71482]:       </backingStore>
Apr 12 09:11:42 user nova-compute[71482]:       <target dev='vda' bus='virtio'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='virtio-disk0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </disk>
Apr 12 09:11:42 user nova-compute[71482]:     <disk type='file' device='cdrom'>
Apr 12 09:11:42 user nova-compute[71482]:       <driver name='qemu' type='raw' cache='none'/>
Apr 12 09:11:42 user nova-compute[71482]:       <source file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk.config' index='1'/>
Apr 12 09:11:42 user nova-compute[71482]:       <backingStore/>
Apr 12 09:11:42 user nova-compute[71482]:       <target dev='hda' bus='ide'/>
Apr 12 09:11:42 user nova-compute[71482]:       <readonly/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='ide0-0-0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </disk>
Apr 12 09:11:42 user nova-compute[71482]:     <controller type='usb' index='0' model='none'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='usb'/>
Apr 12 09:11:42 user nova-compute[71482]:     </controller>
Apr 12 09:11:42 user nova-compute[71482]:     <controller type='pci' index='0' model='pci-root'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='pci.0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </controller>
Apr 12 09:11:42 user nova-compute[71482]:     <controller type='ide' index='0'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='ide'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 12 09:11:42 user nova-compute[71482]:     </controller>
Apr 12 09:11:42 user nova-compute[71482]:     <interface type='ethernet'>
Apr 12 09:11:42 user nova-compute[71482]:       <mac address='fa:16:3e:3d:0e:e4'/>
Apr 12 09:11:42 user nova-compute[71482]:       <target dev='tapc7ccda6d-74'/>
Apr 12 09:11:42 user nova-compute[71482]:       <model type='virtio'/>
Apr 12 09:11:42 user nova-compute[71482]:       <mtu size='1442'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='net0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </interface>
Apr 12 09:11:42 user nova-compute[71482]:     <serial type='pty'>
Apr 12 09:11:42 user nova-compute[71482]:       <source path='/dev/pts/8'/>
Apr 12 09:11:42 user nova-compute[71482]:       <log file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log' append='off'/>
Apr 12 09:11:42 user nova-compute[71482]:       <target type='isa-serial' port='0'>
Apr 12 09:11:42 user nova-compute[71482]:         <model name='isa-serial'/>
Apr 12 09:11:42 user nova-compute[71482]:       </target>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='serial0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </serial>
Apr 12 09:11:42 user nova-compute[71482]:     <console type='pty' tty='/dev/pts/8'>
Apr 12 09:11:42 user nova-compute[71482]:       <source path='/dev/pts/8'/>
Apr 12 09:11:42 user nova-compute[71482]:       <log file='/opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/console.log' append='off'/>
Apr 12 09:11:42 user nova-compute[71482]:       <target type='serial' port='0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='serial0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </console>
Apr 12 09:11:42 user nova-compute[71482]:     <input type='mouse' bus='ps2'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='input0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </input>
Apr 12 09:11:42 user nova-compute[71482]:     <input type='keyboard' bus='ps2'>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='input1'/>
Apr 12 09:11:42 user nova-compute[71482]:     </input>
Apr 12 09:11:42 user nova-compute[71482]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Apr 12 09:11:42 user nova-compute[71482]:       <listen type='address' address='0.0.0.0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </graphics>
Apr 12 09:11:42 user nova-compute[71482]:     <audio id='1' type='none'/>
Apr 12 09:11:42 user nova-compute[71482]:     <video>
Apr 12 09:11:42 user nova-compute[71482]:       <model type='virtio' heads='1' primary='yes'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='video0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </video>
Apr 12 09:11:42 user nova-compute[71482]:     <memballoon model='virtio'>
Apr 12 09:11:42 user nova-compute[71482]:       <stats period='10'/>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='balloon0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </memballoon>
Apr 12 09:11:42 user nova-compute[71482]:     <rng model='virtio'>
Apr 12 09:11:42 user nova-compute[71482]:       <backend model='random'>/dev/urandom</backend>
Apr 12 09:11:42 user nova-compute[71482]:       <alias name='rng0'/>
Apr 12 09:11:42 user nova-compute[71482]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 12 09:11:42 user nova-compute[71482]:     </rng>
Apr 12 09:11:42 user nova-compute[71482]:   </devices>
Apr 12 09:11:42 user nova-compute[71482]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 12 09:11:42 user nova-compute[71482]:     <label>libvirt-fbbb84fb-1d35-4249-8c8a-d9a02176243c</label>
Apr 12 09:11:42 user nova-compute[71482]:     <imagelabel>libvirt-fbbb84fb-1d35-4249-8c8a-d9a02176243c</imagelabel>
Apr 12 09:11:42 user nova-compute[71482]:   </seclabel>
Apr 12 09:11:42 user nova-compute[71482]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 12 09:11:42 user nova-compute[71482]:     <label>+64055:+108</label>
Apr 12 09:11:42 user nova-compute[71482]:     <imagelabel>+64055:+108</imagelabel>
Apr 12 09:11:42 user nova-compute[71482]:   </seclabel>
Apr 12 09:11:42 user nova-compute[71482]: </domain>
Apr 12 09:11:42 user nova-compute[71482]:  {{(pid=71482) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 12 09:11:42 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Detaching interface fa:16:3e:fa:4e:39 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap15e598ed-6d' not found.
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091699595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2091699595',id=9,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ==',key_name='tempest-keypair-591560650',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed443186516c4075ab14a4b0be130e31',ramdisk_id='',reservation_id='r-zd9zb9ej',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1337552011',owner_user_name='tempest-TaggedAttachmentsTest-1337552011-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc97c54107de479bade4014982d79287',uuid=fbbb84fb-1d35-4249-8c8a-d9a02176243c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.os_vif_util [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Converting VIF {"id": "15e598ed-6d82-4978-9ea7-57da256807b3", "address": "fa:16:3e:fa:4e:39", "network": {"id": "b72c2dd7-a524-4a85-b998-79b95dc7b90c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2033536146", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15e598ed-6d", "ovs_interfaceid": "15e598ed-6d82-4978-9ea7-57da256807b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.os_vif_util [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG os_vif [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15e598ed-6d, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:11:42 user nova-compute[71482]: INFO os_vif [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:4e:39,bridge_name='br-int',has_traffic_filtering=True,id=15e598ed-6d82-4978-9ea7-57da256807b3,network=Network(b72c2dd7-a524-4a85-b998-79b95dc7b90c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15e598ed-6d')
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [req-7b6a24e0-1085-4cf2-9755-17020cdbcea8 req-0ab58bc4-fad4-4ed1-b8eb-d11e28048b0f service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:11:42 user nova-compute[71482]:   <nova:package version="0.0.0"/>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:name>tempest-device-tagging-server-2091699595</nova:name>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:creationTime>2023-04-12 09:11:42</nova:creationTime>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:flavor name="m1.nano">
Apr 12 09:11:42 user nova-compute[71482]:     <nova:memory>128</nova:memory>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:disk>1</nova:disk>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:swap>0</nova:swap>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:vcpus>1</nova:vcpus>
Apr 12 09:11:42 user nova-compute[71482]:   </nova:flavor>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:owner>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:user uuid="bc97c54107de479bade4014982d79287">tempest-TaggedAttachmentsTest-1337552011-project-member</nova:user>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:project uuid="ed443186516c4075ab14a4b0be130e31">tempest-TaggedAttachmentsTest-1337552011</nova:project>
Apr 12 09:11:42 user nova-compute[71482]:   </nova:owner>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:11:42 user nova-compute[71482]:   <nova:ports>
Apr 12 09:11:42 user nova-compute[71482]:     <nova:port uuid="c7ccda6d-74db-4747-a5eb-dba5e82506fa">
Apr 12 09:11:42 user nova-compute[71482]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:11:42 user nova-compute[71482]:     </nova:port>
Apr 12 09:11:42 user nova-compute[71482]:   </nova:ports>
Apr 12 09:11:42 user nova-compute[71482]: </nova:instance>
Apr 12 09:11:42 user nova-compute[71482]:  {{(pid=71482) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:42 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Took 1.63 seconds to deallocate network for instance.
Apr 12 09:11:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcUeqNZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26537316661333132', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537316661333132', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'flavor' on Instance uuid a5e42339-50fa-411c-94a1-c350727b7955 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.neutron [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updated VIF entry in instance network info cache for port 2c417659-5031-44dd-9796-062033960cc6. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.network.neutron [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updating instance_info_cache with network_info: [{"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-abb03824-6bcb-468b-a4ff-a5495efd7337 req-96b699ba-69cd-476f-9e17-ab6e02d4e0f3 service nova] Releasing lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:11:42 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:42 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:11:42 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:42 user nova-compute[71482]:   <serial>4531b054-1af7-4630-8d73-8f1bac8a7723</serial>
Apr 12 09:11:42 user nova-compute[71482]: </disk>
Apr 12 09:11:42 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqNvPSFC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '8efa7873-7011-4a2d-9e41-54b8ed92441a': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:43 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dc36de-433e-4051-a0b6-3c4bdce60452]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:11:43 user nova-compute[71482]: No targets found.
Apr 12 09:11:43 user nova-compute[71482]: iSNS:
Apr 12 09:11:43 user nova-compute[71482]: No targets found.
Apr 12 09:11:43 user nova-compute[71482]: STATIC:
Apr 12 09:11:43 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320
Apr 12 09:11:43 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:43 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:43 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723
Apr 12 09:11:43 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:43 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:43 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a
Apr 12 09:11:43 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:43 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:43 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:11:43 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:43 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:43 user nova-compute[71482]: FIRMWARE:
Apr 12 09:11:43 user nova-compute[71482]: No targets found.
Apr 12 09:11:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:11:43 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:11:43 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07466ff-4d39-454e-a314-e0d4d62c2625]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ce4fb2-c541-4dbe-b63e-eae86fc4568d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)
Apr 12 09:11:43 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:43 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:43 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)
Apr 12 09:11:43 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:43 user nova-compute[71482]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a (non-flash)
Apr 12 09:11:43 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9344351f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a'): ({'sde'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Removing single pathed devices sde {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bc1802-6c8b-4881-baf5-440da9c3b478]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: INFO nova.network.neutron [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Port 15e598ed-6d82-4978-9ea7-57da256807b3 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.network.neutron [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating instance_info_cache with network_info: [{"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c5a7eb-807f-4917-bea9-889cbe2320f9]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Flushing IO for device /dev/sde {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Releasing lock "refresh_cache-fbbb84fb-1d35-4249-8c8a-d9a02176243c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e368dd7-89d3-4ba0-b3c7-c569c5903e02]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-527aac22-7623-4668-8b9d-b652822fdddc tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "interface-fbbb84fb-1d35-4249-8c8a-d9a02176243c-15e598ed-6d82-4978-9ea7-57da256807b3" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.230s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87dbd7e-e6a7-4782-bcec-a652db52e926]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] SCSI volumes sde have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Deleted allocations for instance 22eabe74-0932-472e-8090-09e8431f4f4a
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[234007ce-ef99-44c9-b7bb-a7c28ae26802]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-8b80aae7-b880-4a1b-82fa-238816a92d0d req-b3ac57a6-7cb3-4f43-81ef-c4180ace4805 service nova] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Received event network-vif-deleted-f3af3839-bbd2-4152-ab34-91c767220af4 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[472fa67a-24bc-481f-95c3-0fd646dc1118]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a, portal: 172.16.0.220,3260]
Apr 12 09:11:43 user nova-compute[71482]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59dc67fd-fc63-4f41-95ef-44c7a8b7b045 tempest-AttachSCSIVolumeTestJSON-580617659 tempest-AttachSCSIVolumeTestJSON-580617659-project-member] Lock "22eabe74-0932-472e-8090-09e8431f4f4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.226s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8efa7873-7011-4a2d-9e41-54b8ed92441a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[751d2733-1fbe-49e3-b208-5b036d0d9e8b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] <== disconnect_volume: return (323ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvyPecQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '94f40323-58a6-4e9c-b26b-23615dde13d3', 'attached_at': '', 'detached_at': '', 'volume_id': '297e37c3-cfa1-4064-98b5-4565c088c320', 'serial'} {{(pid=71482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] swap_volume: removing Cinder connection for volume 8efa7873-7011-4a2d-9e41-54b8ed92441a {{(pid=71482) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No VIF found with MAC fa:16:3e:d0:b5:14, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a92c74eb-e079-442a-abd4-03935b48a4db tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.748s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-plugged-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] No waiting events found dispatching network-vif-plugged-15e598ed-6d82-4978-9ea7-57da256807b3 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:43 user nova-compute[71482]: WARNING nova.compute.manager [req-3ce1dd53-7e67-4fa7-9156-a56491de3239 req-b84aedfd-7035-4536-a641-6b8f25d98bd4 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received unexpected event network-vif-plugged-15e598ed-6d82-4978-9ea7-57da256807b3 for instance with vm_state active and task_state None.
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG nova.compute.manager [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] swap_volume: Updating volume 8efa7873-7011-4a2d-9e41-54b8ed92441a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "NvyPecQB", "auth_password": "ROP8j0GDU4ZwFz", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "297e37c3-cfa1-4064-98b5-4565c088c320"}, "status": "reserved", "instance": "94f40323-58a6-4e9c-b26b-23615dde13d3", "attached_at": "", "detached_at": "", "volume_id": "297e37c3-cfa1-4064-98b5-4565c088c320", "serial": "297e37c3-cfa1-4064-98b5-4565c088c320"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '297e37c3-cfa1-4064-98b5-4565c088c320', 'no_device': None, 'attachment_id': '5ecc9743-52b0-47ac-95e3-b7d98d090f5e'} {{(pid=71482) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-56eecfeb-ea82-4414-b812-f42165327500 tempest-TestVolumeSwap-1832868586 tempest-TestVolumeSwap-1832868586-project-admin] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.361s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG os_brick.utils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf0f4b2-2cf1-4319-bd2a-3eb1eb5181a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[db232ca0-d20a-44db-82eb-8c5b10311a51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba17f39b-f637-4a18-b2e7-05595847c642]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[004ce154-d3d2-4e2d-95ad-92f4042cdf46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:11:44 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:11:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d6f26b-dfb0-4e75-89dc-79a7462e3869]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG os_brick.utils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:44 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updating existing volume attachment record: bb8ed7d1-d2a4-41b6-a8c6-7480d1ff0513 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:45 user nova-compute[71482]: INFO nova.compute.manager [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Detaching volume 4531b054-1af7-4630-8d73-8f1bac8a7723
Apr 12 09:11:45 user nova-compute[71482]: INFO nova.compute.manager [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Detaching volume 297e37c3-cfa1-4064-98b5-4565c088c320
Apr 12 09:11:45 user nova-compute[71482]: INFO nova.virt.block_device [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Attempting to driver detach volume 4531b054-1af7-4630-8d73-8f1bac8a7723 from mountpoint /dev/vdb
Apr 12 09:11:45 user nova-compute[71482]: INFO nova.virt.block_device [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Attempting to driver detach volume 297e37c3-cfa1-4064-98b5-4565c088c320 from mountpoint /dev/vdb
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Attempting to detach device vdb from instance a5e42339-50fa-411c-94a1-c350727b7955 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:45 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:45 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:11:45 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:45 user nova-compute[71482]:   <serial>4531b054-1af7-4630-8d73-8f1bac8a7723</serial>
Apr 12 09:11:45 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:11:45 user nova-compute[71482]: </disk>
Apr 12 09:11:45 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Attempting to detach device vdb from instance 94f40323-58a6-4e9c-b26b-23615dde13d3 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:45 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:45 user nova-compute[71482]:   <source dev="/dev/sdf"/>
Apr 12 09:11:45 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:45 user nova-compute[71482]:   <serial>297e37c3-cfa1-4064-98b5-4565c088c320</serial>
Apr 12 09:11:45 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:11:45 user nova-compute[71482]: </disk>
Apr 12 09:11:45 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Successfully detached device vdb from instance a5e42339-50fa-411c-94a1-c350727b7955 from the persistent domain config.
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a5e42339-50fa-411c-94a1-c350727b7955 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:45 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:45 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:11:45 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:45 user nova-compute[71482]:   <serial>4531b054-1af7-4630-8d73-8f1bac8a7723</serial>
Apr 12 09:11:45 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:11:45 user nova-compute[71482]: </disk>
Apr 12 09:11:45 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Successfully detached device vdb from instance 94f40323-58a6-4e9c-b26b-23615dde13d3 from the persistent domain config.
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94f40323-58a6-4e9c-b26b-23615dde13d3 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:11:45 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:45 user nova-compute[71482]:   <source dev="/dev/sdf"/>
Apr 12 09:11:45 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:11:45 user nova-compute[71482]:   <serial>297e37c3-cfa1-4064-98b5-4565c088c320</serial>
Apr 12 09:11:45 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:11:45 user nova-compute[71482]: </disk>
Apr 12 09:11:45 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681290705.7718174, 94f40323-58a6-4e9c-b26b-23615dde13d3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:11:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Successfully detached device vdb from instance 94f40323-58a6-4e9c-b26b-23615dde13d3 from the live domain config.
Apr 12 09:11:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NvyPecQB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '297e37c3-cfa1-4064-98b5-4565c088c320': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:45 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[44302032-3fba-4101-9c6d-613ae6f955a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:11:45 user nova-compute[71482]: No targets found.
Apr 12 09:11:45 user nova-compute[71482]: iSNS:
Apr 12 09:11:45 user nova-compute[71482]: No targets found.
Apr 12 09:11:45 user nova-compute[71482]: STATIC:
Apr 12 09:11:45 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320
Apr 12 09:11:45 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:45 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:45 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723
Apr 12 09:11:45 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:45 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:45 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:11:45 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:45 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:45 user nova-compute[71482]: FIRMWARE:
Apr 12 09:11:45 user nova-compute[71482]: No targets found.
Apr 12 09:11:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:11:45 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:11:45 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb012861-33bb-4361-b03f-bf2d0b306950]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d4ff1b-9bce-42ff-9eac-2a1195b2f06f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)
Apr 12 09:11:45 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:45 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)
Apr 12 09:11:45 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:45 user nova-compute[71482]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 (non-flash)
Apr 12 09:11:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c166b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320'): ({'sdf'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Removing single pathed devices sdf {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f84d4-eb43-478b-902e-ec25ede2b283]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca178b7-1907-4972-9c27-64d26be0a078]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Flushing IO for device /dev/sdf {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2a922b-8dbb-4fbe-b7a3-cbee53a03417]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42e0911-6484-4117-8d25-d8efdffd7553]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] SCSI volumes sdf have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6f7d50-1aed-4453-900e-069d03610e35]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4a088e-fa92-4f2d-8fa4-96d0d6b7a7c3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260]
Apr 12 09:11:46 user nova-compute[71482]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:297e37c3-cfa1-4064-98b5-4565c088c320 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[235180eb-e98c-4f2f-bfc0-0cd2c69d01e9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] <== disconnect_volume: return (283ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681290706.075141, a5e42339-50fa-411c-94a1-c350727b7955 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a5e42339-50fa-411c-94a1-c350727b7955 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:11:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Successfully detached device vdb from instance a5e42339-50fa-411c-94a1-c350727b7955 from the live domain config.
Apr 12 09:11:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcUeqNZT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:46 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6964f1c8-ac55-4066-a1d8-2dc72370727f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:11:46 user nova-compute[71482]: No targets found.
Apr 12 09:11:46 user nova-compute[71482]: iSNS:
Apr 12 09:11:46 user nova-compute[71482]: No targets found.
Apr 12 09:11:46 user nova-compute[71482]: STATIC:
Apr 12 09:11:46 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723
Apr 12 09:11:46 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:46 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:46 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:11:46 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:11:46 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:11:46 user nova-compute[71482]: FIRMWARE:
Apr 12 09:11:46 user nova-compute[71482]: No targets found.
Apr 12 09:11:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:11:46 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:11:46 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c4df3-b3c9-4044-813d-d9210b8dda36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c63b49-e1cf-4a42-a82a-f3dad4289c93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)
Apr 12 09:11:46 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 (non-flash)
Apr 12 09:11:46 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9344351cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c26d13-7dc9-4315-9c48-0f48c3699691]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9faf2c-8248-474a-8215-781164d04f31]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[576901ff-188d-454e-88d7-7ff242d65931]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c85936-a79c-415f-8765-fe426ecb3d27]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d336f624-7a58-47a6-a9c1-cff65a17c24a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fb2936-10f8-427c-8e52-0178273bc373]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723, portal: 172.16.0.220,3260]
Apr 12 09:11:46 user nova-compute[71482]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4531b054-1af7-4630-8d73-8f1bac8a7723 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce539cdd-2f64-4bfc-827b-25532c10fa3a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] <== disconnect_volume: return (331ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lazy-loading 'flavor' on Instance uuid 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a0f83c9f-953d-4c22-877f-0377e3afaa7a tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.838s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG nova.objects.instance [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'flavor' on Instance uuid a5e42339-50fa-411c-94a1-c350727b7955 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aa9f9a39-e3f2-4c17-8f4f-dd5a1609459f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.097s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:11:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:11:49 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Creating image(s)
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Ensure instance console log exists: /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Start _get_guest_xml network_info=[{"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bb8ed7d1-d2a4-41b6-a8c6-7480d1ff0513', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGLmXMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e2070294-eb8a-4ee9-a4b5-baab508d8744', 'attached_at': '', 'detached_at': '', 'volume_id': '4192d3db-69e0-430c-a44a-27c9d897c4ae', 'serial': '4192d3db-69e0-430c-a44a-27c9d897c4ae'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:11:49 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:11:49 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7905MB free_disk=26.53719711303711GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:49 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:11:49 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGLmXMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:11:49 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:49 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:11:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:11:49 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b0192e-4d1b-4e07-b77e-ef16122e381b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:11:49 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[48597b15-4097-44b2-a93d-c89d4e684607]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae] added
Apr 12 09:11:50 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52896c19-1c84-401a-8e16-aadc54da19df]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f683bc12-8fca-47de-b28e-a0070e77b387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 94f40323-58a6-4e9c-b26b-23615dde13d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a5e42339-50fa-411c-94a1-c350727b7955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8282341-453a-4592-9c33-c4217c507fd9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvGLmXMJ {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvGLmXMJ" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b861095-04c1-4086-9f36-c73c138ac563]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvGLmXMJ'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8737d9-acc7-4e88-8221-2004cca33486]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f919c4-1571-472b-90d4-f9cba37099b8]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:50 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:50 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d02a3fe-6a3f-4d92-8ab0-1e86352bb4da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae, portal: 172.16.0.220,3260]
Apr 12 09:11:50 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae, portal: 172.16.0.220,3260] successful.
Apr 12 09:11:50 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.068s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[036349cf-1fe2-4bef-b8ae-176c5bf94b22]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1be3db4-e8db-4dbb-bbf9-995ac98297d2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:11:50 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:50 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:11:50 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:11:50 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[606450a1-9c8d-4189-a4ba-154b03749a1d]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGLmXMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:11:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26464383365316439', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464383365316439', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1955348970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1955348970',id=12,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-e5mpec81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:11:38Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=e2070294-eb8a-4ee9-a4b5-baab508d8744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c417659-5031-44dd-9796-062033960cc6,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c417659-50') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.objects.instance [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'pci_devices' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:11:51 user nova-compute[71482]:   <uuid>e2070294-eb8a-4ee9-a4b5-baab508d8744</uuid>
Apr 12 09:11:51 user nova-compute[71482]:   <name>instance-0000000c</name>
Apr 12 09:11:51 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:11:51 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:11:51 user nova-compute[71482]:   <metadata>
Apr 12 09:11:51 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:11:51 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:11:51 user nova-compute[71482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1955348970</nova:name>
Apr 12 09:11:51 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:11:49</nova:creationTime>
Apr 12 09:11:51 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:11:51 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:11:51 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:11:51 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:11:51 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:11:51 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:11:51 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:11:51 user nova-compute[71482]:       <nova:owner>
Apr 12 09:11:51 user nova-compute[71482]:         <nova:user uuid="cc51704e74b045ad9733a43aec982390">tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member</nova:user>
Apr 12 09:11:51 user nova-compute[71482]:         <nova:project uuid="a6ce4a0f4dad40c18fd8a83470c15f05">tempest-ServerBootFromVolumeStableRescueTest-1244466684</nova:project>
Apr 12 09:11:51 user nova-compute[71482]:       </nova:owner>
Apr 12 09:11:51 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:11:51 user nova-compute[71482]:       <nova:ports>
Apr 12 09:11:51 user nova-compute[71482]:         <nova:port uuid="2c417659-5031-44dd-9796-062033960cc6">
Apr 12 09:11:51 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:11:51 user nova-compute[71482]:         </nova:port>
Apr 12 09:11:51 user nova-compute[71482]:       </nova:ports>
Apr 12 09:11:51 user nova-compute[71482]:     </nova:instance>
Apr 12 09:11:51 user nova-compute[71482]:   </metadata>
Apr 12 09:11:51 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:11:51 user nova-compute[71482]:     <system>
Apr 12 09:11:51 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:11:51 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:11:51 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:11:51 user nova-compute[71482]:       <entry name="serial">e2070294-eb8a-4ee9-a4b5-baab508d8744</entry>
Apr 12 09:11:51 user nova-compute[71482]:       <entry name="uuid">e2070294-eb8a-4ee9-a4b5-baab508d8744</entry>
Apr 12 09:11:51 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:11:51 user nova-compute[71482]:     </system>
Apr 12 09:11:51 user nova-compute[71482]:   </sysinfo>
Apr 12 09:11:51 user nova-compute[71482]:   <os>
Apr 12 09:11:51 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:11:51 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:11:51 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:11:51 user nova-compute[71482]:   </os>
Apr 12 09:11:51 user nova-compute[71482]:   <features>
Apr 12 09:11:51 user nova-compute[71482]:     <acpi/>
Apr 12 09:11:51 user nova-compute[71482]:     <apic/>
Apr 12 09:11:51 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:11:51 user nova-compute[71482]:   </features>
Apr 12 09:11:51 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:11:51 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:11:51 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:11:51 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:11:51 user nova-compute[71482]:   </clock>
Apr 12 09:11:51 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:11:51 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:11:51 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:11:51 user nova-compute[71482]:   </cpu>
Apr 12 09:11:51 user nova-compute[71482]:   <devices>
Apr 12 09:11:51 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:11:51 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:11:51 user nova-compute[71482]:       <source dev="/dev/sdc"/>
Apr 12 09:11:51 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:11:51 user nova-compute[71482]:       <serial>4192d3db-69e0-430c-a44a-27c9d897c4ae</serial>
Apr 12 09:11:51 user nova-compute[71482]:     </disk>
Apr 12 09:11:51 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:11:51 user nova-compute[71482]:       <mac address="fa:16:3e:77:49:9c"/>
Apr 12 09:11:51 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:11:51 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:11:51 user nova-compute[71482]:       <target dev="tap2c417659-50"/>
Apr 12 09:11:51 user nova-compute[71482]:     </interface>
Apr 12 09:11:51 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:11:51 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/console.log" append="off"/>
Apr 12 09:11:51 user nova-compute[71482]:     </serial>
Apr 12 09:11:51 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:11:51 user nova-compute[71482]:     <video>
Apr 12 09:11:51 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:11:51 user nova-compute[71482]:     </video>
Apr 12 09:11:51 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:11:51 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:11:51 user nova-compute[71482]:     </rng>
Apr 12 09:11:51 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:11:51 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:11:51 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:11:51 user nova-compute[71482]:     </memballoon>
Apr 12 09:11:51 user nova-compute[71482]:   </devices>
Apr 12 09:11:51 user nova-compute[71482]: </domain>
Apr 12 09:11:51 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1955348970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1955348970',id=12,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-e5mpec81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:11:38Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=e2070294-eb8a-4ee9-a4b5-baab508d8744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c417659-5031-44dd-9796-062033960cc6,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c417659-50') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG os_vif [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c417659-5031-44dd-9796-062033960cc6,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c417659-50') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c417659-50, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c417659-50, col_values=(('external_ids', {'iface-id': '2c417659-5031-44dd-9796-062033960cc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:49:9c', 'vm-uuid': 'e2070294-eb8a-4ee9-a4b5-baab508d8744'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:51 user nova-compute[71482]: INFO os_vif [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c417659-5031-44dd-9796-062033960cc6,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c417659-50')
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:11:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No VIF found with MAC fa:16:3e:77:49:9c, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:11:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:53 user nova-compute[71482]: WARNING nova.compute.manager [req-f414a7ed-b776-42cc-be1a-3a2d8e010dc8 req-fca4e881-e426-4b63-ab40-cca19c79ee44 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state building and task_state spawning.
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290714.8375456, e2070294-eb8a-4ee9-a4b5-baab508d8744 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:11:54 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] VM Resumed (Lifecycle Event)
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:11:54 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Instance spawned successfully.
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:11:54 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290714.8394995, e2070294-eb8a-4ee9-a4b5-baab508d8744 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:11:54 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] VM Started (Lifecycle Event)
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:11:54 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:11:54 user nova-compute[71482]: INFO nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Took 5.05 seconds to spawn the instance on the hypervisor.
Apr 12 09:11:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:11:55 user nova-compute[71482]: INFO nova.compute.manager [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Took 17.42 seconds to build instance.
Apr 12 09:11:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4d150247-b272-478c-9db0-394884fe2aa8 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.530s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:55 user nova-compute[71482]: DEBUG nova.compute.manager [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:11:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:11:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:11:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:11:55 user nova-compute[71482]: DEBUG nova.compute.manager [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:11:55 user nova-compute[71482]: WARNING nova.compute.manager [req-87ab0e14-4445-4009-b3cb-0c1e8db7f9c4 req-f97d33a6-8185-41a6-97a2-42e9d22c8d43 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state active and task_state None.
Apr 12 09:11:55 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290700.965603, 22eabe74-0932-472e-8090-09e8431f4f4a => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:11:55 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] VM Stopped (Lifecycle Event)
Apr 12 09:11:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-c71ad660-ea30-46e5-ade3-4dc87889717b None None] [instance: 22eabe74-0932-472e-8090-09e8431f4f4a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:11:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:11:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:12:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:12:02 user nova-compute[71482]: INFO nova.compute.claims [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Claim successful on node user
Apr 12 09:12:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.network.neutron [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:12:03 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.policy [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9afc908ad0e4ba9ab74006817cc0895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28ede6e9cdbc4b71a1affaddfd1ad9a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:12:03 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Creating image(s)
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk 1073741824" returned: 0 in 0.049s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:12:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Successfully created port: dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Cannot resize image /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.objects.instance [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'migration_context' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Ensure instance console log exists: /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Successfully updated port: dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquired lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-changed-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Refreshing instance network info cache due to event network-changed-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] Acquiring lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:12:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.network.neutron [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updating instance_info_cache with network_info: [{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Releasing lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Instance network_info: |[{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] Acquired lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.network.neutron [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Refreshing network info cache for port dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Start _get_guest_xml network_info=[{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:12:05 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:05 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-430343469',display_name='tempest-ServerStableDeviceRescueTest-server-430343469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-430343469',id=13,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4vJjgMKDKaWr0Dy8W2bVCeXaYOmTVfeTv9/3UEUmN+6itpsXzbaWpnFjPJUdjwFtuYYeFZdZPUeplH0aO/nZtpvGeDHXHuXoefAJJIu7CBy1InWrkCMQqKrIm1eU6g5A==',key_name='tempest-keypair-681767073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28ede6e9cdbc4b71a1affaddfd1ad9a3',ramdisk_id='',reservation_id='r-7c212l7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1869366097',owner_user_name='tempest-ServerStableDeviceRescueTest-1869366097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9afc908ad0e4ba9ab74006817cc0895',uuid=7cec0e09-36ac-43c7-9299-819b65c9da6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Converting VIF {"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:48:ac,bridge_name='br-int',has_traffic_filtering=True,id=dd53e034-3c1a-4153-b8ba-fc9db5cfea0e,network=Network(a113fe76-9546-4c8d-9c26-762c017f777f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd53e034-3c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.objects.instance [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:12:05 user nova-compute[71482]:   <uuid>7cec0e09-36ac-43c7-9299-819b65c9da6b</uuid>
Apr 12 09:12:05 user nova-compute[71482]:   <name>instance-0000000d</name>
Apr 12 09:12:05 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:12:05 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:12:05 user nova-compute[71482]:   <metadata>
Apr 12 09:12:05 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:12:05 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:12:05 user nova-compute[71482]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-430343469</nova:name>
Apr 12 09:12:05 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:12:05</nova:creationTime>
Apr 12 09:12:05 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:12:05 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:12:05 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:12:05 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:12:05 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:12:05 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:12:05 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:12:05 user nova-compute[71482]:       <nova:owner>
Apr 12 09:12:05 user nova-compute[71482]:         <nova:user uuid="d9afc908ad0e4ba9ab74006817cc0895">tempest-ServerStableDeviceRescueTest-1869366097-project-member</nova:user>
Apr 12 09:12:05 user nova-compute[71482]:         <nova:project uuid="28ede6e9cdbc4b71a1affaddfd1ad9a3">tempest-ServerStableDeviceRescueTest-1869366097</nova:project>
Apr 12 09:12:05 user nova-compute[71482]:       </nova:owner>
Apr 12 09:12:05 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:12:05 user nova-compute[71482]:       <nova:ports>
Apr 12 09:12:05 user nova-compute[71482]:         <nova:port uuid="dd53e034-3c1a-4153-b8ba-fc9db5cfea0e">
Apr 12 09:12:05 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 09:12:05 user nova-compute[71482]:         </nova:port>
Apr 12 09:12:05 user nova-compute[71482]:       </nova:ports>
Apr 12 09:12:05 user nova-compute[71482]:     </nova:instance>
Apr 12 09:12:05 user nova-compute[71482]:   </metadata>
Apr 12 09:12:05 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:12:05 user nova-compute[71482]:     <system>
Apr 12 09:12:05 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:12:05 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:12:05 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:12:05 user nova-compute[71482]:       <entry name="serial">7cec0e09-36ac-43c7-9299-819b65c9da6b</entry>
Apr 12 09:12:05 user nova-compute[71482]:       <entry name="uuid">7cec0e09-36ac-43c7-9299-819b65c9da6b</entry>
Apr 12 09:12:05 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:12:05 user nova-compute[71482]:     </system>
Apr 12 09:12:05 user nova-compute[71482]:   </sysinfo>
Apr 12 09:12:05 user nova-compute[71482]:   <os>
Apr 12 09:12:05 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:12:05 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:12:05 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:12:05 user nova-compute[71482]:   </os>
Apr 12 09:12:05 user nova-compute[71482]:   <features>
Apr 12 09:12:05 user nova-compute[71482]:     <acpi/>
Apr 12 09:12:05 user nova-compute[71482]:     <apic/>
Apr 12 09:12:05 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:12:05 user nova-compute[71482]:   </features>
Apr 12 09:12:05 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:12:05 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:12:05 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:12:05 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:12:05 user nova-compute[71482]:   </clock>
Apr 12 09:12:05 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:12:05 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:12:05 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:12:05 user nova-compute[71482]:   </cpu>
Apr 12 09:12:05 user nova-compute[71482]:   <devices>
Apr 12 09:12:05 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:12:05 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:12:05 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk"/>
Apr 12 09:12:05 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:12:05 user nova-compute[71482]:     </disk>
Apr 12 09:12:05 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:12:05 user nova-compute[71482]:       <mac address="fa:16:3e:5d:48:ac"/>
Apr 12 09:12:05 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:12:05 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:12:05 user nova-compute[71482]:       <target dev="tapdd53e034-3c"/>
Apr 12 09:12:05 user nova-compute[71482]:     </interface>
Apr 12 09:12:05 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:12:05 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/console.log" append="off"/>
Apr 12 09:12:05 user nova-compute[71482]:     </serial>
Apr 12 09:12:05 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:12:05 user nova-compute[71482]:     <video>
Apr 12 09:12:05 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:12:05 user nova-compute[71482]:     </video>
Apr 12 09:12:05 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:12:05 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:12:05 user nova-compute[71482]:     </rng>
Apr 12 09:12:05 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:12:05 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:12:05 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:12:05 user nova-compute[71482]:     </memballoon>
Apr 12 09:12:05 user nova-compute[71482]:   </devices>
Apr 12 09:12:05 user nova-compute[71482]: </domain>
Apr 12 09:12:05 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-430343469',display_name='tempest-ServerStableDeviceRescueTest-server-430343469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-430343469',id=13,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4vJjgMKDKaWr0Dy8W2bVCeXaYOmTVfeTv9/3UEUmN+6itpsXzbaWpnFjPJUdjwFtuYYeFZdZPUeplH0aO/nZtpvGeDHXHuXoefAJJIu7CBy1InWrkCMQqKrIm1eU6g5A==',key_name='tempest-keypair-681767073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28ede6e9cdbc4b71a1affaddfd1ad9a3',ramdisk_id='',reservation_id='r-7c212l7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1869366097',owner_user_name='tempest-ServerStableDeviceRescueTest-1869366097-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9afc908ad0e4ba9ab74006817cc0895',uuid=7cec0e09-36ac-43c7-9299-819b65c9da6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Converting VIF {"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:48:ac,bridge_name='br-int',has_traffic_filtering=True,id=dd53e034-3c1a-4153-b8ba-fc9db5cfea0e,network=Network(a113fe76-9546-4c8d-9c26-762c017f777f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd53e034-3c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG os_vif [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:48:ac,bridge_name='br-int',has_traffic_filtering=True,id=dd53e034-3c1a-4153-b8ba-fc9db5cfea0e,network=Network(a113fe76-9546-4c8d-9c26-762c017f777f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd53e034-3c') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd53e034-3c, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd53e034-3c, col_values=(('external_ids', {'iface-id': 'dd53e034-3c1a-4153-b8ba-fc9db5cfea0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:48:ac', 'vm-uuid': '7cec0e09-36ac-43c7-9299-819b65c9da6b'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:05 user nova-compute[71482]: INFO os_vif [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:48:ac,bridge_name='br-int',has_traffic_filtering=True,id=dd53e034-3c1a-4153-b8ba-fc9db5cfea0e,network=Network(a113fe76-9546-4c8d-9c26-762c017f777f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd53e034-3c')
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] No VIF found with MAC fa:16:3e:5d:48:ac, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.network.neutron [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updated VIF entry in instance network info cache for port dd53e034-3c1a-4153-b8ba-fc9db5cfea0e. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG nova.network.neutron [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updating instance_info_cache with network_info: [{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-320d49d2-f995-4035-b7f1-e5478436fea1 req-7f84342e-205d-4e50-90bf-362d2dcbe854 service nova] Releasing lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:12:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:06 user nova-compute[71482]: WARNING nova.compute.manager [req-aa3afacc-ff8e-45ec-8d67-4c1c24f3ced6 req-0c213480-6956-4bef-97cf-3fffaafc54e0 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state building and task_state spawning.
Apr 12 09:12:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290728.701882, 7cec0e09-36ac-43c7-9299-819b65c9da6b => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:12:08 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] VM Resumed (Lifecycle Event)
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:12:08 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Instance spawned successfully.
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:08 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290728.707834, 7cec0e09-36ac-43c7-9299-819b65c9da6b => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:12:08 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] VM Started (Lifecycle Event)
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:12:08 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:12:08 user nova-compute[71482]: INFO nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Took 5.42 seconds to spawn the instance on the hypervisor.
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:08 user nova-compute[71482]: WARNING nova.compute.manager [req-7ea9d776-1b54-4c14-83df-3e12ff927436 req-bb8a54c2-7e7f-4942-8ba2-bd522319cc3a service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state building and task_state spawning.
Apr 12 09:12:08 user nova-compute[71482]: INFO nova.compute.manager [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Took 6.16 seconds to build instance.
Apr 12 09:12:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-720b695f-0668-4c10-93de-462e39d631e9 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.256s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "f4a3ed65-d508-476d-975d-e8dceb64565a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:12:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:16 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:12:16 user nova-compute[71482]: INFO nova.compute.claims [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Claim successful on node user
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.network.neutron [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:12:17 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.policy [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8911ec7c959541989cce3870ba11fb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9e7d6ece244a96b01277451a3ed5a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:12:17 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Creating image(s)
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "/opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "/opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk 1073741824" returned: 0 in 0.047s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.network.neutron [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Successfully created port: 36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Cannot resize image /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.objects.instance [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'migration_context' on Instance uuid f4a3ed65-d508-476d-975d-e8dceb64565a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Ensure instance console log exists: /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Successfully updated port: 36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:12:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "refresh_cache-f4a3ed65-d508-476d-975d-e8dceb64565a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:12:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquired lock "refresh_cache-f4a3ed65-d508-476d-975d-e8dceb64565a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:12:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:12:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received event network-changed-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Refreshing instance network info cache due to event network-changed-36f04153-f10f-4525-9dd6-35f943897a28. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:12:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] Acquiring lock "refresh_cache-f4a3ed65-d508-476d-975d-e8dceb64565a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:12:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.network.neutron [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Updating instance_info_cache with network_info: [{"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Releasing lock "refresh_cache-f4a3ed65-d508-476d-975d-e8dceb64565a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Instance network_info: |[{"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] Acquired lock "refresh_cache-f4a3ed65-d508-476d-975d-e8dceb64565a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Refreshing network info cache for port 36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Start _get_guest_xml network_info=[{"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:12:19 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:19 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-904443664',display_name='tempest-VolumesAdminNegativeTest-server-904443664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-904443664',id=14,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd9e7d6ece244a96b01277451a3ed5a5',ramdisk_id='',reservation_id='r-vxp51tpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-588655718',owner_user_name='tempest-VolumesAdminNegativeTest-588655718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:12:17Z,user_data=None,user_id='8911ec7c959541989cce3870ba11fb80',uuid=f4a3ed65-d508-476d-975d-e8dceb64565a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converting VIF {"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:65:51,bridge_name='br-int',has_traffic_filtering=True,id=36f04153-f10f-4525-9dd6-35f943897a28,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04153-f1') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.objects.instance [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'pci_devices' on Instance uuid f4a3ed65-d508-476d-975d-e8dceb64565a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:12:19 user nova-compute[71482]:   <uuid>f4a3ed65-d508-476d-975d-e8dceb64565a</uuid>
Apr 12 09:12:19 user nova-compute[71482]:   <name>instance-0000000e</name>
Apr 12 09:12:19 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:12:19 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:12:19 user nova-compute[71482]:   <metadata>
Apr 12 09:12:19 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:12:19 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:12:19 user nova-compute[71482]:       <nova:name>tempest-VolumesAdminNegativeTest-server-904443664</nova:name>
Apr 12 09:12:19 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:12:19</nova:creationTime>
Apr 12 09:12:19 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:12:19 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:12:19 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:12:19 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:12:19 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:12:19 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:12:19 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:12:19 user nova-compute[71482]:       <nova:owner>
Apr 12 09:12:19 user nova-compute[71482]:         <nova:user uuid="8911ec7c959541989cce3870ba11fb80">tempest-VolumesAdminNegativeTest-588655718-project-member</nova:user>
Apr 12 09:12:19 user nova-compute[71482]:         <nova:project uuid="dd9e7d6ece244a96b01277451a3ed5a5">tempest-VolumesAdminNegativeTest-588655718</nova:project>
Apr 12 09:12:19 user nova-compute[71482]:       </nova:owner>
Apr 12 09:12:19 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:12:19 user nova-compute[71482]:       <nova:ports>
Apr 12 09:12:19 user nova-compute[71482]:         <nova:port uuid="36f04153-f10f-4525-9dd6-35f943897a28">
Apr 12 09:12:19 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 09:12:19 user nova-compute[71482]:         </nova:port>
Apr 12 09:12:19 user nova-compute[71482]:       </nova:ports>
Apr 12 09:12:19 user nova-compute[71482]:     </nova:instance>
Apr 12 09:12:19 user nova-compute[71482]:   </metadata>
Apr 12 09:12:19 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:12:19 user nova-compute[71482]:     <system>
Apr 12 09:12:19 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:12:19 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:12:19 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:12:19 user nova-compute[71482]:       <entry name="serial">f4a3ed65-d508-476d-975d-e8dceb64565a</entry>
Apr 12 09:12:19 user nova-compute[71482]:       <entry name="uuid">f4a3ed65-d508-476d-975d-e8dceb64565a</entry>
Apr 12 09:12:19 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:12:19 user nova-compute[71482]:     </system>
Apr 12 09:12:19 user nova-compute[71482]:   </sysinfo>
Apr 12 09:12:19 user nova-compute[71482]:   <os>
Apr 12 09:12:19 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:12:19 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:12:19 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:12:19 user nova-compute[71482]:   </os>
Apr 12 09:12:19 user nova-compute[71482]:   <features>
Apr 12 09:12:19 user nova-compute[71482]:     <acpi/>
Apr 12 09:12:19 user nova-compute[71482]:     <apic/>
Apr 12 09:12:19 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:12:19 user nova-compute[71482]:   </features>
Apr 12 09:12:19 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:12:19 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:12:19 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:12:19 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:12:19 user nova-compute[71482]:   </clock>
Apr 12 09:12:19 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:12:19 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:12:19 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:12:19 user nova-compute[71482]:   </cpu>
Apr 12 09:12:19 user nova-compute[71482]:   <devices>
Apr 12 09:12:19 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:12:19 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:12:19 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk"/>
Apr 12 09:12:19 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:12:19 user nova-compute[71482]:     </disk>
Apr 12 09:12:19 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:12:19 user nova-compute[71482]:       <mac address="fa:16:3e:9f:65:51"/>
Apr 12 09:12:19 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:12:19 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:12:19 user nova-compute[71482]:       <target dev="tap36f04153-f1"/>
Apr 12 09:12:19 user nova-compute[71482]:     </interface>
Apr 12 09:12:19 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:12:19 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/console.log" append="off"/>
Apr 12 09:12:19 user nova-compute[71482]:     </serial>
Apr 12 09:12:19 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:12:19 user nova-compute[71482]:     <video>
Apr 12 09:12:19 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:12:19 user nova-compute[71482]:     </video>
Apr 12 09:12:19 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:12:19 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:12:19 user nova-compute[71482]:     </rng>
Apr 12 09:12:19 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:12:19 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:12:19 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:12:19 user nova-compute[71482]:     </memballoon>
Apr 12 09:12:19 user nova-compute[71482]:   </devices>
Apr 12 09:12:19 user nova-compute[71482]: </domain>
Apr 12 09:12:19 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-904443664',display_name='tempest-VolumesAdminNegativeTest-server-904443664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-904443664',id=14,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd9e7d6ece244a96b01277451a3ed5a5',ramdisk_id='',reservation_id='r-vxp51tpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-588655718',owner_user_name='tempest-VolumesAdminNegativeTest-588655718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:12:17Z,user_data=None,user_id='8911ec7c959541989cce3870ba11fb80',uuid=f4a3ed65-d508-476d-975d-e8dceb64565a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converting VIF {"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:65:51,bridge_name='br-int',has_traffic_filtering=True,id=36f04153-f10f-4525-9dd6-35f943897a28,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04153-f1') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG os_vif [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:65:51,bridge_name='br-int',has_traffic_filtering=True,id=36f04153-f10f-4525-9dd6-35f943897a28,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04153-f1') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36f04153-f1, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap36f04153-f1, col_values=(('external_ids', {'iface-id': '36f04153-f10f-4525-9dd6-35f943897a28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:65:51', 'vm-uuid': 'f4a3ed65-d508-476d-975d-e8dceb64565a'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:19 user nova-compute[71482]: INFO os_vif [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:65:51,bridge_name='br-int',has_traffic_filtering=True,id=36f04153-f10f-4525-9dd6-35f943897a28,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04153-f1')
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] No VIF found with MAC fa:16:3e:9f:65:51, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Updated VIF entry in instance network info cache for port 36f04153-f10f-4525-9dd6-35f943897a28. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Updating instance_info_cache with network_info: [{"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c9cb1c8f-e9d8-4c38-95c1-ad4080d55eac req-94e2845b-6ae0-4584-ab53-d4189643da6b service nova] Releasing lock "refresh_cache-f4a3ed65-d508-476d-975d-e8dceb64565a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:12:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received event network-vif-plugged-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] Acquiring lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] No waiting events found dispatching network-vif-plugged-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:21 user nova-compute[71482]: WARNING nova.compute.manager [req-c69b3905-57d9-421b-9eac-68088fdd33e1 req-5b3e391e-1f06-48c0-8318-b27a5baad43b service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received unexpected event network-vif-plugged-36f04153-f10f-4525-9dd6-35f943897a28 for instance with vm_state building and task_state spawning.
Apr 12 09:12:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290742.8251138, f4a3ed65-d508-476d-975d-e8dceb64565a => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:12:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] VM Resumed (Lifecycle Event)
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:12:22 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Instance spawned successfully.
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290742.8281326, f4a3ed65-d508-476d-975d-e8dceb64565a => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:12:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] VM Started (Lifecycle Event)
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:12:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:12:22 user nova-compute[71482]: INFO nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Took 5.66 seconds to spawn the instance on the hypervisor.
Apr 12 09:12:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:23 user nova-compute[71482]: INFO nova.compute.manager [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Took 6.39 seconds to build instance.
Apr 12 09:12:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25873ca7-80db-409f-adec-b2928ca01153 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.476s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:23 user nova-compute[71482]: DEBUG nova.compute.manager [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received event network-vif-plugged-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] Acquiring lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:23 user nova-compute[71482]: DEBUG nova.compute.manager [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] No waiting events found dispatching network-vif-plugged-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:23 user nova-compute[71482]: WARNING nova.compute.manager [req-c4dfe5ca-446f-4311-80ff-9103b07bed2b req-f3c38ea5-8b1e-403f-ac8b-62928a4ff9df service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received unexpected event network-vif-plugged-36f04153-f10f-4525-9dd6-35f943897a28 for instance with vm_state active and task_state None.
Apr 12 09:12:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:31 user nova-compute[71482]: INFO nova.compute.manager [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Terminating instance
Apr 12 09:12:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-unplugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] No waiting events found dispatching network-vif-unplugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-ddac5905-801f-4b6c-bd29-5771cf46b27f req-4572d003-3886-4784-9598-091df5e45dc2 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-unplugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:12:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Instance destroyed successfully.
Apr 12 09:12:32 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lazy-loading 'resources' on Instance uuid fbbb84fb-1d35-4249-8c8a-d9a02176243c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2091699595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-2091699595',id=9,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBw0jfy3MikIxF963TRclLOyoJdicmerCUo/mpHajBgXSkuWhGkg1cJfPW3gu5T+tRFSY+YRWOAF9us16rdarCQHnq7HzpnPxCOraqeq24dBU5qSqr5jkVRQK5YPnL9YEQ==',key_name='tempest-keypair-591560650',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed443186516c4075ab14a4b0be130e31',ramdisk_id='',reservation_id='r-zd9zb9ej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1337552011',owner_user_name='tempest-TaggedAttachmentsTest-1337552011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc97c54107de479bade4014982d79287',uuid=fbbb84fb-1d35-4249-8c8a-d9a02176243c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converting VIF {"id": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "address": "fa:16:3e:3d:0e:e4", "network": {"id": "00c625ad-e5a3-4c0d-b3d2-7b78e9385843", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1024673844-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed443186516c4075ab14a4b0be130e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7ccda6d-74", "ovs_interfaceid": "c7ccda6d-74db-4747-a5eb-dba5e82506fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:0e:e4,bridge_name='br-int',has_traffic_filtering=True,id=c7ccda6d-74db-4747-a5eb-dba5e82506fa,network=Network(00c625ad-e5a3-4c0d-b3d2-7b78e9385843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ccda6d-74') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG os_vif [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:0e:e4,bridge_name='br-int',has_traffic_filtering=True,id=c7ccda6d-74db-4747-a5eb-dba5e82506fa,network=Network(00c625ad-e5a3-4c0d-b3d2-7b78e9385843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ccda6d-74') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7ccda6d-74, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:32 user nova-compute[71482]: INFO os_vif [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:0e:e4,bridge_name='br-int',has_traffic_filtering=True,id=c7ccda6d-74db-4747-a5eb-dba5e82506fa,network=Network(00c625ad-e5a3-4c0d-b3d2-7b78e9385843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7ccda6d-74')
Apr 12 09:12:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Deleting instance files /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c_del
Apr 12 09:12:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Deletion of /opt/stack/data/nova/instances/fbbb84fb-1d35-4249-8c8a-d9a02176243c_del complete
Apr 12 09:12:32 user nova-compute[71482]: INFO nova.compute.manager [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 12 09:12:32 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:12:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:33 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-deleted-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:33 user nova-compute[71482]: INFO nova.compute.manager [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Neutron deleted interface c7ccda6d-74db-4747-a5eb-dba5e82506fa; detaching it from the instance and deleting it from the info cache
Apr 12 09:12:33 user nova-compute[71482]: DEBUG nova.network.neutron [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:33 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Took 0.91 seconds to deallocate network for instance.
Apr 12 09:12:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-72d6291c-08d3-4276-887f-323016ff5acf req-d95b80f1-f8dd-4b2e-86bc-24132ea68b78 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Detach interface failed, port_id=c7ccda6d-74db-4747-a5eb-dba5e82506fa, reason: Instance fbbb84fb-1d35-4249-8c8a-d9a02176243c could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:12:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:34 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:12:34 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:12:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received event network-vif-plugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] Acquiring lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] No waiting events found dispatching network-vif-plugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:34 user nova-compute[71482]: WARNING nova.compute.manager [req-7e6dd9a7-b83f-4816-a681-94872457d61d req-42c8fdac-4d69-468c-a076-18dafa80e517 service nova] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Received unexpected event network-vif-plugged-c7ccda6d-74db-4747-a5eb-dba5e82506fa for instance with vm_state deleted and task_state None.
Apr 12 09:12:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:34 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Deleted allocations for instance fbbb84fb-1d35-4249-8c8a-d9a02176243c
Apr 12 09:12:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2c796df5-63bd-47f8-8f5e-dad04032eaa9 tempest-TaggedAttachmentsTest-1337552011 tempest-TaggedAttachmentsTest-1337552011-project-member] Lock "fbbb84fb-1d35-4249-8c8a-d9a02176243c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.520s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:35 user nova-compute[71482]: INFO nova.compute.manager [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Terminating instance
Apr 12 09:12:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:12:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received event network-vif-unplugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] No waiting events found dispatching network-vif-unplugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-23166335-4a32-4e0f-89b8-dad2749f1a44 req-b4755113-d18f-49b9-aaf6-8608066fec86 service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received event network-vif-unplugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:12:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Instance destroyed successfully.
Apr 12 09:12:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lazy-loading 'resources' on Instance uuid 94f40323-58a6-4e9c-b26b-23615dde13d3 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:09:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2129617709',display_name='tempest-TestVolumeSwap-server-2129617709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2129617709',id=7,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJm8EQfriZimJKZoTG24j09PT/XZoMDm7SAU3ypiuEbNdxZ7SDdwTjNlIAeyrJyWOC6PfocSe31LVOsrXRfE2T4ylMmBcmnO+zWFD54VyS6dBRK8fJqLCAXg2n2r8fndkQ==',key_name='tempest-keypair-1337351931',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70f74eae85c24a72a048bdd03e4d4f19',ramdisk_id='',reservation_id='r-g70ucqhy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1881322649',owner_user_name='tempest-TestVolumeSwap-1881322649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df9257c2223d417298b5927f7b99ac07',uuid=94f40323-58a6-4e9c-b26b-23615dde13d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Converting VIF {"id": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "address": "fa:16:3e:e7:c0:df", "network": {"id": "ece9cc91-9a3c-48d7-bce4-760fc01a51f3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-694499792-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70f74eae85c24a72a048bdd03e4d4f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3cd67b3-27", "ovs_interfaceid": "d3cd67b3-275a-4eef-b0c5-b2da33a783f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:c0:df,bridge_name='br-int',has_traffic_filtering=True,id=d3cd67b3-275a-4eef-b0c5-b2da33a783f9,network=Network(ece9cc91-9a3c-48d7-bce4-760fc01a51f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cd67b3-27') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG os_vif [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:c0:df,bridge_name='br-int',has_traffic_filtering=True,id=d3cd67b3-275a-4eef-b0c5-b2da33a783f9,network=Network(ece9cc91-9a3c-48d7-bce4-760fc01a51f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cd67b3-27') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3cd67b3-27, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:36 user nova-compute[71482]: INFO os_vif [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:c0:df,bridge_name='br-int',has_traffic_filtering=True,id=d3cd67b3-275a-4eef-b0c5-b2da33a783f9,network=Network(ece9cc91-9a3c-48d7-bce4-760fc01a51f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3cd67b3-27')
Apr 12 09:12:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Deleting instance files /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3_del
Apr 12 09:12:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Deletion of /opt/stack/data/nova/instances/94f40323-58a6-4e9c-b26b-23615dde13d3_del complete
Apr 12 09:12:36 user nova-compute[71482]: INFO nova.compute.manager [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 09:12:36 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:12:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:37 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:37 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Took 0.85 seconds to deallocate network for instance.
Apr 12 09:12:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:37 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:12:37 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:12:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:37 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Deleted allocations for instance 94f40323-58a6-4e9c-b26b-23615dde13d3
Apr 12 09:12:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a9bbb479-2485-48c3-b9e4-f213b439d3ef tempest-TestVolumeSwap-1881322649 tempest-TestVolumeSwap-1881322649-project-member] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.326s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received event network-vif-plugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] Acquiring lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] Lock "94f40323-58a6-4e9c-b26b-23615dde13d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] No waiting events found dispatching network-vif-plugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:38 user nova-compute[71482]: WARNING nova.compute.manager [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received unexpected event network-vif-plugged-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 for instance with vm_state deleted and task_state None.
Apr 12 09:12:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-25ab3df4-bb02-4e7e-9e67-2d72bf841325 req-f5a6cbc8-4f13-4bcd-9841-bc82a52fb74c service nova] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Received event network-vif-deleted-d3cd67b3-275a-4eef-b0c5-b2da33a783f9 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:38 user nova-compute[71482]: INFO nova.compute.manager [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] instance snapshotting
Apr 12 09:12:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Beginning live snapshot process
Apr 12 09:12:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json -f qcow2 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json -f qcow2" returned: 0 in 0.154s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json -f qcow2 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:39 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:39 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:39 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:39 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf1478595/9bee6e026f6c4d2aa3a050d0804cbb27.delta 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:39 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpf1478595/9bee6e026f6c4d2aa3a050d0804cbb27.delta 1073741824" returned: 0 in 0.047s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:39 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 09:12:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:12:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:12:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 09:12:40 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:12:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf1478595/9bee6e026f6c4d2aa3a050d0804cbb27.delta /opt/stack/data/nova/instances/snapshots/tmpf1478595/9bee6e026f6c4d2aa3a050d0804cbb27 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpf1478595/9bee6e026f6c4d2aa3a050d0804cbb27.delta /opt/stack/data/nova/instances/snapshots/tmpf1478595/9bee6e026f6c4d2aa3a050d0804cbb27" returned: 0 in 0.230s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Snapshot extracted, beginning image upload
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG nova.objects.instance [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'flavor' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:41 user nova-compute[71482]: INFO nova.compute.manager [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attaching volume 95e901df-9a3a-4145-a12e-c77232853864 to /dev/vdb
Apr 12 09:12:41 user nova-compute[71482]: DEBUG os_brick.utils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3173ee8b-419a-4f36-a4cd-d5fb080ea561]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc71acf-fe37-46cb-9ced-6e5b4f5ad2df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eede21ac-0ec0-4cb7-a933-edb13531cf2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2d3af0-4fd5-4e0d-9d06-bad7b573dd7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:12:41 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:12:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1c093f-8d13-4eb4-bce2-1eebf705dc4a]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG os_brick.utils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:12:41 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating existing volume attachment record: 8efaa1ad-c2d5-4244-b8a5-29698494081f {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updating instance_info_cache with network_info: [{"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:43 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Snapshot image upload complete
Apr 12 09:12:43 user nova-compute[71482]: INFO nova.compute.manager [None req-c5f343f0-2a59-40bf-9793-55a958d2d35f tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Took 4.69 seconds to snapshot the instance on the hypervisor.
Apr 12 09:12:44 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:44 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:12:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhczbRsE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:12:45 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:12:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:12:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:12:45 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:12:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:12:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:12:45 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:12:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdab043-a572-4901-9fad-c70b16d77668]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:12:45 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3d8c02-d2d9-48b4-a99f-418b6dc2c8ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864] added
Apr 12 09:12:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45586481-a6d6-4f72-91bc-03a51ca6c2cd]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abe9deb-6918-495f-9239-887634e2c540]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhczbRsE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhczbRsE" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba0dfc3-669c-41db-b7eb-48fa78b86f3f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhczbRsE'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc101ec-7eb2-4fbb-872e-c93c917615dc]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f4c98f-2720-49d1-806d-fe74b9421722]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:46 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:46 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c131a04c-3da3-4983-8e88-a1a5dbc6d891]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260]
Apr 12 09:12:46 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260] successful.
Apr 12 09:12:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfecddb0-e0d2-4d24-818c-0d3871957f6f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[704cde1b-c850-4542-8635-6fa1f06bfdf8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:46 user nova-compute[71482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:12:46 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:46 user nova-compute[71482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:12:46 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HCTL ('35', '-', '-', 0) found on session 12 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bede048-eabc-4e66-a3ed-3b8211d925ef]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Searching for a device in session 12 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhczbRsE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:12:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23966333634396665', 'path': '/dev/sdd'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966333634396665', 'path': '/dev/sdd'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.objects.instance [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'flavor' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:12:47 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:12:47 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:12:47 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:12:47 user nova-compute[71482]:   <serial>95e901df-9a3a-4145-a12e-c77232853864</serial>
Apr 12 09:12:47 user nova-compute[71482]: </disk>
Apr 12 09:12:47 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:12:47 user nova-compute[71482]: INFO nova.compute.claims [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Claim successful on node user
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290752.6116056, fbbb84fb-1d35-4249-8c8a-d9a02176243c => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:12:47 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] VM Stopped (Lifecycle Event)
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-16e4e1f8-63b9-45bd-a3a4-d79655eff577 None None] [instance: fbbb84fb-1d35-4249-8c8a-d9a02176243c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No VIF found with MAC fa:16:3e:9b:4e:53, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-605a2e6a-0d3b-44df-8f24-d57c853107d4 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.275s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.488s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:12:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:12:48 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG nova.policy [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0440debc9af46e690788752e32f0912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d39dd859ed4684a659c79ca3ea3fb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:12:48 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Creating image(s)
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "/opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "/opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "/opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "9e1a18b1b27dbee040866b9884156aae6173e57c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "9e1a18b1b27dbee040866b9884156aae6173e57c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:48 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.852s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: INFO nova.compute.manager [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Rebuilding instance
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c.part --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.virt.images [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] f789b5a9-8687-4ad6-89b8-6ba9685a94d3 was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c.part /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.objects.instance [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.compute.manager [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c.part /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c.converted" returned: 0 in 0.210s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.objects.instance [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'pci_requests' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.objects.instance [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.objects.instance [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'resources' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.objects.instance [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'migration_context' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.objects.instance [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71482) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "9e1a18b1b27dbee040866b9884156aae6173e57c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.379s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c --force-share --output=json" returned: 0 in 0.156s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "9e1a18b1b27dbee040866b9884156aae6173e57c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "9e1a18b1b27dbee040866b9884156aae6173e57c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:49 user nova-compute[71482]: WARNING nova.compute.manager [req-4646fc60-21fb-4631-ac6a-22db9ccaacca req-822bb8eb-879e-4fc0-a463-706989a49477 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state rebuilding.
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c --force-share --output=json" returned: 0 in 0.155s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c,backing_fmt=raw /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c,backing_fmt=raw /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk 1073741824" returned: 0 in 0.046s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "9e1a18b1b27dbee040866b9884156aae6173e57c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Successfully created port: cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c --force-share --output=json" returned: 0 in 0.166s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG nova.objects.instance [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'migration_context' on Instance uuid 3872dcd7-8f2e-4b6e-9450-f8939143a94d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Ensure instance console log exists: /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance destroyed successfully.
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: INFO nova.compute.manager [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Detaching volume 95e901df-9a3a-4145-a12e-c77232853864
Apr 12 09:12:50 user nova-compute[71482]: INFO nova.virt.block_device [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attempting to driver detach volume 95e901df-9a3a-4145-a12e-c77232853864 from mountpoint /dev/vdb
Apr 12 09:12:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Attempting to detach device vdb from instance 4f211820-161b-4bef-b25d-ced137325da1 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:12:50 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:12:50 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:12:50 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:12:50 user nova-compute[71482]:   <serial>95e901df-9a3a-4145-a12e-c77232853864</serial>
Apr 12 09:12:50 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:12:50 user nova-compute[71482]: </disk>
Apr 12 09:12:50 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:12:50 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully detached device vdb from instance 4f211820-161b-4bef-b25d-ced137325da1 from the persistent domain config.
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhczbRsE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:12:50 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a9fe44-95d3-4412-bb12-19997d9f93c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:12:50 user nova-compute[71482]: No targets found.
Apr 12 09:12:50 user nova-compute[71482]: iSNS:
Apr 12 09:12:50 user nova-compute[71482]: No targets found.
Apr 12 09:12:50 user nova-compute[71482]: STATIC:
Apr 12 09:12:50 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864
Apr 12 09:12:50 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:12:50 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:12:50 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:12:50 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:12:50 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:12:50 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:12:50 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:12:50 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:12:50 user nova-compute[71482]: FIRMWARE:
Apr 12 09:12:50 user nova-compute[71482]: No targets found.
Apr 12 09:12:50 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:12:50 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:12:50 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff630d2-71d6-4729-ac32-884face9062d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[184e5b2b-0bf6-4d44-a419-903c5125437d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:50 user nova-compute[71482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:12:50 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:50 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:50 user nova-compute[71482]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:12:50 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:50 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c10e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864'): ({'sdd'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Removing single pathed devices sdd {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf7503d-88db-4fdc-b241-ec541778c969]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee38335-ee5c-4754-9f76-1081f9906e6b]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flushing IO for device /dev/sdd {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4ffe34-f06d-4c0d-9e6e-00de5d971ee4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b5f7ad-19c9-4acf-968d-b8ce7df3a014]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a89b18e-9bfe-4604-8e8c-32a44d8b58e3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.network.neutron [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Successfully updated port: cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquired lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.network.neutron [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fce13f3-45de-414b-a88e-608fa66239b2]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260]
Apr 12 09:12:51 user nova-compute[71482]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260] successful.
Apr 12 09:12:51 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received event network-changed-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Refreshing instance network info cache due to event network-changed-cbba3d0e-337f-4f59-90b6-6216192cdb3b. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] Acquiring lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eccc86-0f84-4136-89ca-9c6cf59c8c8e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.403s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== disconnect_volume: return (405ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.network.neutron [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290756.4152534, 94f40323-58a6-4e9c-b26b-23615dde13d3 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:12:51 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] VM Stopped (Lifecycle Event)
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1938c4fb-a67c-4980-93a8-ccf296552062 None None] [instance: 94f40323-58a6-4e9c-b26b-23615dde13d3] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.network.neutron [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Updating instance_info_cache with network_info: [{"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Releasing lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Instance network_info: |[{"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] Acquired lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.network.neutron [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Refreshing network info cache for port cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Start _get_guest_xml network_info=[{"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='66b14a06de0943362798c96840fc7f5e',container_format='bare',created_at=2023-04-12T09:12:38Z,direct_url=<?>,disk_format='qcow2',id=f789b5a9-8687-4ad6-89b8-6ba9685a94d3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-670761549',owner='81d39dd859ed4684a659c79ca3ea3fb4',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T09:12:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'f789b5a9-8687-4ad6-89b8-6ba9685a94d3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:12:51 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:51 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='66b14a06de0943362798c96840fc7f5e',container_format='bare',created_at=2023-04-12T09:12:38Z,direct_url=<?>,disk_format='qcow2',id=f789b5a9-8687-4ad6-89b8-6ba9685a94d3,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-670761549',owner='81d39dd859ed4684a659c79ca3ea3fb4',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-12T09:12:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-957660484',display_name='tempest-TestStampPattern-server-957660484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-957660484',id=15,image_ref='f789b5a9-8687-4ad6-89b8-6ba9685a94d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+fsSS3XTWnvMjjcXo2M/eSLvS9TQwtC5Vw9sxk2wzTZ75i0he3Eo6b0vT0HPmDlWDm3m80IrirjqBjUz0Z8GQDLK2hw+EpHpQKcspVFgKhBnSTs/WZpB6phNQXZtwf0w==',key_name='tempest-TestStampPattern-1475014031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81d39dd859ed4684a659c79ca3ea3fb4',ramdisk_id='',reservation_id='r-v8nhjbsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a5e42339-50fa-411c-94a1-c350727b7955',image_min_disk='1',image_min_ram='0',image_owner_id='81d39dd859ed4684a659c79ca3ea3fb4',image_owner_project_name='tempest-TestStampPattern-1126496829',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1126496829-project-member',image_user_id='e0440debc9af46e690788752e32f0912',network_allocated='True',owner_project_name='tempest-TestStampPattern-1126496829',owner_user_name='tempest-TestStampPattern-1126496829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:12:48Z,user_data=None,user_id='e0440debc9af46e690788752e32f0912',uuid=3872dcd7-8f2e-4b6e-9450-f8939143a94d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converting VIF {"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b4:61,bridge_name='br-int',has_traffic_filtering=True,id=cbba3d0e-337f-4f59-90b6-6216192cdb3b,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbba3d0e-33') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.objects.instance [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'pci_devices' on Instance uuid 3872dcd7-8f2e-4b6e-9450-f8939143a94d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:12:51 user nova-compute[71482]:   <uuid>3872dcd7-8f2e-4b6e-9450-f8939143a94d</uuid>
Apr 12 09:12:51 user nova-compute[71482]:   <name>instance-0000000f</name>
Apr 12 09:12:51 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:12:51 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:12:51 user nova-compute[71482]:   <metadata>
Apr 12 09:12:51 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:12:51 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:12:51 user nova-compute[71482]:       <nova:name>tempest-TestStampPattern-server-957660484</nova:name>
Apr 12 09:12:51 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:12:51</nova:creationTime>
Apr 12 09:12:51 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:12:51 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:12:51 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:12:51 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:12:51 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:12:51 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:12:51 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:12:51 user nova-compute[71482]:       <nova:owner>
Apr 12 09:12:51 user nova-compute[71482]:         <nova:user uuid="e0440debc9af46e690788752e32f0912">tempest-TestStampPattern-1126496829-project-member</nova:user>
Apr 12 09:12:51 user nova-compute[71482]:         <nova:project uuid="81d39dd859ed4684a659c79ca3ea3fb4">tempest-TestStampPattern-1126496829</nova:project>
Apr 12 09:12:51 user nova-compute[71482]:       </nova:owner>
Apr 12 09:12:51 user nova-compute[71482]:       <nova:root type="image" uuid="f789b5a9-8687-4ad6-89b8-6ba9685a94d3"/>
Apr 12 09:12:51 user nova-compute[71482]:       <nova:ports>
Apr 12 09:12:51 user nova-compute[71482]:         <nova:port uuid="cbba3d0e-337f-4f59-90b6-6216192cdb3b">
Apr 12 09:12:51 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 09:12:51 user nova-compute[71482]:         </nova:port>
Apr 12 09:12:51 user nova-compute[71482]:       </nova:ports>
Apr 12 09:12:51 user nova-compute[71482]:     </nova:instance>
Apr 12 09:12:51 user nova-compute[71482]:   </metadata>
Apr 12 09:12:51 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:12:51 user nova-compute[71482]:     <system>
Apr 12 09:12:51 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:12:51 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:12:51 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:12:51 user nova-compute[71482]:       <entry name="serial">3872dcd7-8f2e-4b6e-9450-f8939143a94d</entry>
Apr 12 09:12:51 user nova-compute[71482]:       <entry name="uuid">3872dcd7-8f2e-4b6e-9450-f8939143a94d</entry>
Apr 12 09:12:51 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:12:51 user nova-compute[71482]:     </system>
Apr 12 09:12:51 user nova-compute[71482]:   </sysinfo>
Apr 12 09:12:51 user nova-compute[71482]:   <os>
Apr 12 09:12:51 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:12:51 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:12:51 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:12:51 user nova-compute[71482]:   </os>
Apr 12 09:12:51 user nova-compute[71482]:   <features>
Apr 12 09:12:51 user nova-compute[71482]:     <acpi/>
Apr 12 09:12:51 user nova-compute[71482]:     <apic/>
Apr 12 09:12:51 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:12:51 user nova-compute[71482]:   </features>
Apr 12 09:12:51 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:12:51 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:12:51 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:12:51 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:12:51 user nova-compute[71482]:   </clock>
Apr 12 09:12:51 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:12:51 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:12:51 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:12:51 user nova-compute[71482]:   </cpu>
Apr 12 09:12:51 user nova-compute[71482]:   <devices>
Apr 12 09:12:51 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:12:51 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:12:51 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk"/>
Apr 12 09:12:51 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:12:51 user nova-compute[71482]:     </disk>
Apr 12 09:12:51 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:12:51 user nova-compute[71482]:       <mac address="fa:16:3e:d0:b4:61"/>
Apr 12 09:12:51 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:12:51 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:12:51 user nova-compute[71482]:       <target dev="tapcbba3d0e-33"/>
Apr 12 09:12:51 user nova-compute[71482]:     </interface>
Apr 12 09:12:51 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:12:51 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/console.log" append="off"/>
Apr 12 09:12:51 user nova-compute[71482]:     </serial>
Apr 12 09:12:51 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:12:51 user nova-compute[71482]:     <video>
Apr 12 09:12:51 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:12:51 user nova-compute[71482]:     </video>
Apr 12 09:12:51 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:12:51 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:12:51 user nova-compute[71482]:     </rng>
Apr 12 09:12:51 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:12:51 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:12:51 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:12:51 user nova-compute[71482]:     </memballoon>
Apr 12 09:12:51 user nova-compute[71482]:   </devices>
Apr 12 09:12:51 user nova-compute[71482]: </domain>
Apr 12 09:12:51 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-957660484',display_name='tempest-TestStampPattern-server-957660484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-957660484',id=15,image_ref='f789b5a9-8687-4ad6-89b8-6ba9685a94d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+fsSS3XTWnvMjjcXo2M/eSLvS9TQwtC5Vw9sxk2wzTZ75i0he3Eo6b0vT0HPmDlWDm3m80IrirjqBjUz0Z8GQDLK2hw+EpHpQKcspVFgKhBnSTs/WZpB6phNQXZtwf0w==',key_name='tempest-TestStampPattern-1475014031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81d39dd859ed4684a659c79ca3ea3fb4',ramdisk_id='',reservation_id='r-v8nhjbsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a5e42339-50fa-411c-94a1-c350727b7955',image_min_disk='1',image_min_ram='0',image_owner_id='81d39dd859ed4684a659c79ca3ea3fb4',image_owner_project_name='tempest-TestStampPattern-1126496829',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1126496829-project-member',image_user_id='e0440debc9af46e690788752e32f0912',network_allocated='True',owner_project_name='tempest-TestStampPattern-1126496829',owner_user_name='tempest-TestStampPattern-1126496829-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:12:48Z,user_data=None,user_id='e0440debc9af46e690788752e32f0912',uuid=3872dcd7-8f2e-4b6e-9450-f8939143a94d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converting VIF {"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b4:61,bridge_name='br-int',has_traffic_filtering=True,id=cbba3d0e-337f-4f59-90b6-6216192cdb3b,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbba3d0e-33') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG os_vif [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b4:61,bridge_name='br-int',has_traffic_filtering=True,id=cbba3d0e-337f-4f59-90b6-6216192cdb3b,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbba3d0e-33') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbba3d0e-33, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbba3d0e-33, col_values=(('external_ids', {'iface-id': 'cbba3d0e-337f-4f59-90b6-6216192cdb3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:b4:61', 'vm-uuid': '3872dcd7-8f2e-4b6e-9450-f8939143a94d'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:51 user nova-compute[71482]: INFO os_vif [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b4:61,bridge_name='br-int',has_traffic_filtering=True,id=cbba3d0e-337f-4f59-90b6-6216192cdb3b,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbba3d0e-33')
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No VIF found with MAC fa:16:3e:d0:b4:61, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:51 user nova-compute[71482]: WARNING nova.compute.manager [req-d649012f-9afb-4a15-8a0f-31ae89039efe req-6a705d9f-4743-460e-bfb1-01f638e47981 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state rebuilding.
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance destroyed successfully.
Apr 12 09:12:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:12:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_vif [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc64c2a8-53, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:52 user nova-compute[71482]: INFO os_vif [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53')
Apr 12 09:12:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhczbRsE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:12:52 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d659eb-af55-4c25-81d6-9c44d92cb6cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:12:52 user nova-compute[71482]: No targets found.
Apr 12 09:12:52 user nova-compute[71482]: iSNS:
Apr 12 09:12:52 user nova-compute[71482]: No targets found.
Apr 12 09:12:52 user nova-compute[71482]: STATIC:
Apr 12 09:12:52 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:12:52 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:12:52 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:12:52 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:12:52 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:12:52 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:12:52 user nova-compute[71482]: FIRMWARE:
Apr 12 09:12:52 user nova-compute[71482]: No targets found.
Apr 12 09:12:52 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:12:52 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:12:52 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35b178e-0b9c-49d1-9d1a-2fcdfe6c39da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5b2c0e-c060-4ab4-a5fe-4118f9e81f07]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:52 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:52 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:52 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:52 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c1aa710>, {}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Disconnecting from: [] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.110s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== disconnect_volume: return (111ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:12:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Deleting instance files /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1_del
Apr 12 09:12:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Deletion of /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1_del complete
Apr 12 09:12:52 user nova-compute[71482]: DEBUG nova.network.neutron [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Updated VIF entry in instance network info cache for port cbba3d0e-337f-4f59-90b6-6216192cdb3b. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG nova.network.neutron [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Updating instance_info_cache with network_info: [{"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8cec49ce-d44e-4a84-b123-8471837989c5 req-7af3b29c-4e4f-4ad9-afc5-69b2b704019a service nova] Releasing lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:12:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290775.2662156, 3872dcd7-8f2e-4b6e-9450-f8939143a94d => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:12:55 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] VM Resumed (Lifecycle Event)
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received event network-vif-plugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] No waiting events found dispatching network-vif-plugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:55 user nova-compute[71482]: WARNING nova.compute.manager [req-302f058e-f27d-44bc-b9ec-0d1837b3af77 req-f6e4c881-af3c-436b-a28e-40ae813b574e service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received unexpected event network-vif-plugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance with vm_state building and task_state spawning.
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received event network-vif-plugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] No waiting events found dispatching network-vif-plugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:12:55 user nova-compute[71482]: WARNING nova.compute.manager [req-fc915167-c8b2-4f73-847f-6fc9d6ff2c2c req-a07ee46a-3436-4ea4-8a83-9edd151557e4 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received unexpected event network-vif-plugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance with vm_state building and task_state spawning.
Apr 12 09:12:55 user nova-compute[71482]: INFO nova.virt.block_device [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Booting with volume 95e901df-9a3a-4145-a12e-c77232853864 at /dev/vdb
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:12:55 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Instance spawned successfully.
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:12:55 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:55 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7856MB free_disk=26.51003646850586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:12:55 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290775.2665167, 3872dcd7-8f2e-4b6e-9450-f8939143a94d => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:12:55 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] VM Started (Lifecycle Event)
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquired lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'info_cache' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG os_brick.utils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f70595-7d91-407c-a07e-00133cd6870c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1215d0f-4fd2-4dbc-8e7a-f005044df711]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:55 user nova-compute[71482]: INFO nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Took 7.68 seconds to spawn the instance on the hypervisor.
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:55 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa88266d-a845-4f32-b157-2efa926b7f56]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e29c41-4dea-43e4-9d7c-83a247dfe9d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:12:55 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:12:55 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce7e8e8-76dc-4384-a47e-ac2cd637e687]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG os_brick.utils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:12:55 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating existing volume attachment record: a7ef8aa6-7851-4ee7-914c-b04cf90f72c4 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:12:55 user nova-compute[71482]: INFO nova.compute.manager [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Took 8.57 seconds to build instance.
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-327f37ed-86ac-4172-ac4a-3cecf1850daf tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.660s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f683bc12-8fca-47de-b28e-a0070e77b387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a5e42339-50fa-411c-94a1-c350727b7955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f4a3ed65-d508-476d-975d-e8dceb64565a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updating instance_info_cache with network_info: [{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Releasing lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:12:56 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance destroyed successfully.
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'resources' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-9128142',display_name='tempest-AttachVolumeTestJSON-server-9128142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-9128142',id=5,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w==',key_name='tempest-keypair-2058620837',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-hp2b9h01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=f683bc12-8fca-47de-b28e-a0070e77b387,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_vif [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape957a8ce-db, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:12:56 user nova-compute[71482]: INFO os_vif [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db')
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWzKUNkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:12:56 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a15b7f7-a6be-405f-b6c1-c4cd8f01face]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:12:56 user nova-compute[71482]: No targets found.
Apr 12 09:12:56 user nova-compute[71482]: iSNS:
Apr 12 09:12:56 user nova-compute[71482]: No targets found.
Apr 12 09:12:56 user nova-compute[71482]: STATIC:
Apr 12 09:12:56 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:12:56 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:12:56 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:12:56 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:12:56 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:12:56 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:12:56 user nova-compute[71482]: FIRMWARE:
Apr 12 09:12:56 user nova-compute[71482]: No targets found.
Apr 12 09:12:56 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:12:56 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:12:56 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[53340061-5e53-4a3c-b3a5-a4aa60515e4b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d20dae8-e011-4376-96be-a1afa450685e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:56 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:56 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:56 user nova-compute[71482]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:56 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9349b21ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[374a4aee-45f0-4422-8731-e94850dd8d3a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5222353-fc79-42c0-afa9-47c833206683]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcd2288-9e04-4e7d-ac5d-f67d3764caa5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ff54ab-70af-4dfe-a29b-6ac4cfe70034]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d9ae3b-d17f-4f31-8cbe-097cf5af4cb8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f83640c-f8c6-4e93-910b-0e2afcaf5f19]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260]
Apr 12 09:12:56 user nova-compute[71482]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260] successful.
Apr 12 09:12:56 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[25188abd-8ec1-4b13-ae34-699747173e95]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== disconnect_volume: return (334ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Start _get_guest_xml network_info=[{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'df48de47-1a88-4dae-8a54-e250c827891b', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWzKUNkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f683bc12-8fca-47de-b28e-a0070e77b387', 'attached_at': '', 'detached_at': '', 'volume_id': 'a058b665-da02-444b-8e77-862141ce3a61', 'serial': 'a058b665-da02-444b-8e77-862141ce3a61'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:12:56 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'numa_topology' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:57 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:57 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'vcpu_model' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWzKUNkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:12:57 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:12:57 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:12:57 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d217e1e1-ab30-48ef-b30e-88fd0f2f3388]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:12:57 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3037f770-b14c-45fe-92d2-f5e48b511a2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61] added
Apr 12 09:12:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b327c8-16b5-4ff3-a955-b2d600cb7455]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8272468-b8b0-416c-ae6c-f648863ed824]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWzKUNkr {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PWzKUNkr" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a238ba-3989-4a56-a55f-bc37baccb50f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PWzKUNkr'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9919501e-5e61-46c8-95aa-96ef781a25ee]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abd196b-63a4-441d-8bb7-cbb9ea476562]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45c3919-ead5-4dcc-adfc-3a7626c6daea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260]
Apr 12 09:12:57 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260] successful.
Apr 12 09:12:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f1da2-74d7-41db-a68d-3acd1f0b43a8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3f07fe-fd2d-495a-92a1-82ef958c7f61]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:57 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:12:57 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:12:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c511d6b2-1c5e-40e8-b7a8-e70e95295011]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:12:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWzKUNkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26437383132333634', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437383132333634', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-9128142',display_name='tempest-AttachVolumeTestJSON-server-9128142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-9128142',id=5,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w==',key_name='tempest-keypair-2058620837',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-hp2b9h01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=f683bc12-8fca-47de-b28e-a0070e77b387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'pci_devices' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:12:58 user nova-compute[71482]:   <uuid>f683bc12-8fca-47de-b28e-a0070e77b387</uuid>
Apr 12 09:12:58 user nova-compute[71482]:   <name>instance-00000005</name>
Apr 12 09:12:58 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:12:58 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:12:58 user nova-compute[71482]:   <metadata>
Apr 12 09:12:58 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:12:58 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:12:58 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeTestJSON-server-9128142</nova:name>
Apr 12 09:12:58 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:12:57</nova:creationTime>
Apr 12 09:12:58 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:12:58 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:12:58 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:12:58 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:12:58 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:12:58 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:12:58 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:12:58 user nova-compute[71482]:       <nova:owner>
Apr 12 09:12:58 user nova-compute[71482]:         <nova:user uuid="2a3731bf575c44d89211709cb07060b7">tempest-AttachVolumeTestJSON-1252670961-project-member</nova:user>
Apr 12 09:12:58 user nova-compute[71482]:         <nova:project uuid="23e6ce78ce3d4eb5b4bbb307665c3670">tempest-AttachVolumeTestJSON-1252670961</nova:project>
Apr 12 09:12:58 user nova-compute[71482]:       </nova:owner>
Apr 12 09:12:58 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:12:58 user nova-compute[71482]:       <nova:ports>
Apr 12 09:12:58 user nova-compute[71482]:         <nova:port uuid="e957a8ce-db60-4c11-8fcf-6b88d77e8e4f">
Apr 12 09:12:58 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 09:12:58 user nova-compute[71482]:         </nova:port>
Apr 12 09:12:58 user nova-compute[71482]:       </nova:ports>
Apr 12 09:12:58 user nova-compute[71482]:     </nova:instance>
Apr 12 09:12:58 user nova-compute[71482]:   </metadata>
Apr 12 09:12:58 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:12:58 user nova-compute[71482]:     <system>
Apr 12 09:12:58 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:12:58 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:12:58 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:12:58 user nova-compute[71482]:       <entry name="serial">f683bc12-8fca-47de-b28e-a0070e77b387</entry>
Apr 12 09:12:58 user nova-compute[71482]:       <entry name="uuid">f683bc12-8fca-47de-b28e-a0070e77b387</entry>
Apr 12 09:12:58 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:12:58 user nova-compute[71482]:     </system>
Apr 12 09:12:58 user nova-compute[71482]:   </sysinfo>
Apr 12 09:12:58 user nova-compute[71482]:   <os>
Apr 12 09:12:58 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:12:58 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:12:58 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:12:58 user nova-compute[71482]:   </os>
Apr 12 09:12:58 user nova-compute[71482]:   <features>
Apr 12 09:12:58 user nova-compute[71482]:     <acpi/>
Apr 12 09:12:58 user nova-compute[71482]:     <apic/>
Apr 12 09:12:58 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:12:58 user nova-compute[71482]:   </features>
Apr 12 09:12:58 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:12:58 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:12:58 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:12:58 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:12:58 user nova-compute[71482]:   </clock>
Apr 12 09:12:58 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:12:58 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:12:58 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:12:58 user nova-compute[71482]:   </cpu>
Apr 12 09:12:58 user nova-compute[71482]:   <devices>
Apr 12 09:12:58 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:12:58 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:12:58 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk"/>
Apr 12 09:12:58 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:12:58 user nova-compute[71482]:     </disk>
Apr 12 09:12:58 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:12:58 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:12:58 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:12:58 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:12:58 user nova-compute[71482]:       <serial>a058b665-da02-444b-8e77-862141ce3a61</serial>
Apr 12 09:12:58 user nova-compute[71482]:     </disk>
Apr 12 09:12:58 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:12:58 user nova-compute[71482]:       <mac address="fa:16:3e:f3:e5:20"/>
Apr 12 09:12:58 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:12:58 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:12:58 user nova-compute[71482]:       <target dev="tape957a8ce-db"/>
Apr 12 09:12:58 user nova-compute[71482]:     </interface>
Apr 12 09:12:58 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:12:58 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/console.log" append="off"/>
Apr 12 09:12:58 user nova-compute[71482]:     </serial>
Apr 12 09:12:58 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:12:58 user nova-compute[71482]:     <video>
Apr 12 09:12:58 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:12:58 user nova-compute[71482]:     </video>
Apr 12 09:12:58 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:12:58 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:12:58 user nova-compute[71482]:     </rng>
Apr 12 09:12:58 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:12:58 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:12:58 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:12:58 user nova-compute[71482]:     </memballoon>
Apr 12 09:12:58 user nova-compute[71482]:   </devices>
Apr 12 09:12:58 user nova-compute[71482]: </domain>
Apr 12 09:12:58 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'trusted_certs' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.156s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:12:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Cannot resize image /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'migration_context' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-9128142',display_name='tempest-AttachVolumeTestJSON-server-9128142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-9128142',id=5,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w==',key_name='tempest-keypair-2058620837',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-hp2b9h01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:11:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=f683bc12-8fca-47de-b28e-a0070e77b387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG os_vif [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape957a8ce-db, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape957a8ce-db, col_values=(('external_ids', {'iface-id': 'e957a8ce-db60-4c11-8fcf-6b88d77e8e4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:e5:20', 'vm-uuid': 'f683bc12-8fca-47de-b28e-a0070e77b387'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:12:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:12:59 user nova-compute[71482]: INFO os_vif [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db')
Apr 12 09:13:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:13:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Creating image(s)
Apr 12 09:13:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG nova.compute.manager [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:00 user nova-compute[71482]: DEBUG nova.compute.manager [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:00 user nova-compute[71482]: WARNING nova.compute.manager [req-533958f7-0e1e-444d-b1ea-ef18131e5226 req-8a5cac64-aa3c-4e8b-8cc5-d18e75c5052e service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state stopped and task_state powering-on.
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.171s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.154s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk 1073741824" returned: 0 in 0.050s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Cannot resize image /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Ensure instance console log exists: /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Start _get_guest_xml network_info=[{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a7ef8aa6-7851-4ee7-914c-b04cf90f72c4', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhczbRsE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f211820-161b-4bef-b25d-ced137325da1', 'attached_at': '', 'detached_at': '', 'volume_id': '95e901df-9a3a-4145-a12e-c77232853864', 'serial': '95e901df-9a3a-4145-a12e-c77232853864'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:13:01 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 09:13:01 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.objects.instance [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhczbRsE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:13:01 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:13:01 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:13:01 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[579fd528-6e63-4650-a302-30a13cc5f640]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:13:01 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c31d7b-0225-42c7-b4b6-4f983f45bffd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864] added
Apr 12 09:13:01 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[44143a25-15f8-4d53-b411-6f3f549f8679]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a7e3ef-868b-4444-9570-96613c915bfa]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhczbRsE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhczbRsE" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f6bdd0-2209-46d7-9dc4-2f5eee642770]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhczbRsE'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad14ca0b-86e7-4f65-943c-7c09387c5c07]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec96c0b-92c2-4ddc-9f1a-1569f06c164f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:13:01 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:13:01 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:13:01 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:13:01 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fc22fd-f4dd-44ca-8ae8-616f6f176e87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260]
Apr 12 09:13:01 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260] successful.
Apr 12 09:13:01 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[537130df-1192-4c25-bc41-bbd150267bc2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8af577-8041-482c-bc71-1a1f701b6898]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:13:01 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:13:01 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:13:01 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:13:01 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:13:01 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:13:01 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4434110d-77d4-4cc0-ab58-3647777189d9]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:01 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:13:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:13:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhczbRsE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:13:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:13:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23966333634396665', 'path': '/dev/sdd'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:13:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966333634396665', 'path': '/dev/sdd'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:03 user nova-compute[71482]: WARNING nova.compute.manager [req-20d17be1-bc9c-42c8-b64c-f41dff03ebb5 req-324d0516-1b35-4c71-9b4a-48696052c6b8 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state stopped and task_state powering-on.
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290783.00957, f683bc12-8fca-47de-b28e-a0070e77b387 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:13:03 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] VM Resumed (Lifecycle Event)
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:13:03 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance rebooted successfully.
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e1ec2cf2-80ef-4d27-9cbd-b0e25c877805 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:12:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:13:03 user nova-compute[71482]:   <uuid>4f211820-161b-4bef-b25d-ced137325da1</uuid>
Apr 12 09:13:03 user nova-compute[71482]:   <name>instance-00000003</name>
Apr 12 09:13:03 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:13:03 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:13:03 user nova-compute[71482]:   <metadata>
Apr 12 09:13:03 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:13:03 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:13:03 user nova-compute[71482]:       <nova:name>tempest-ServerActionsTestJSON-server-1204181922</nova:name>
Apr 12 09:13:03 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:13:01</nova:creationTime>
Apr 12 09:13:03 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:13:03 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:13:03 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:13:03 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:13:03 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:13:03 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:13:03 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:13:03 user nova-compute[71482]:       <nova:owner>
Apr 12 09:13:03 user nova-compute[71482]:         <nova:user uuid="375db5b9a80244d3878822049230ba47">tempest-ServerActionsTestJSON-1142062861-project-member</nova:user>
Apr 12 09:13:03 user nova-compute[71482]:         <nova:project uuid="20b8c89c46bb460f9f94be9426a22bb8">tempest-ServerActionsTestJSON-1142062861</nova:project>
Apr 12 09:13:03 user nova-compute[71482]:       </nova:owner>
Apr 12 09:13:03 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:13:03 user nova-compute[71482]:       <nova:ports>
Apr 12 09:13:03 user nova-compute[71482]:         <nova:port uuid="dc64c2a8-533c-40df-b88e-c059cb9cda89">
Apr 12 09:13:03 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 09:13:03 user nova-compute[71482]:         </nova:port>
Apr 12 09:13:03 user nova-compute[71482]:       </nova:ports>
Apr 12 09:13:03 user nova-compute[71482]:     </nova:instance>
Apr 12 09:13:03 user nova-compute[71482]:   </metadata>
Apr 12 09:13:03 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:13:03 user nova-compute[71482]:     <system>
Apr 12 09:13:03 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:13:03 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:13:03 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:13:03 user nova-compute[71482]:       <entry name="serial">4f211820-161b-4bef-b25d-ced137325da1</entry>
Apr 12 09:13:03 user nova-compute[71482]:       <entry name="uuid">4f211820-161b-4bef-b25d-ced137325da1</entry>
Apr 12 09:13:03 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:13:03 user nova-compute[71482]:     </system>
Apr 12 09:13:03 user nova-compute[71482]:   </sysinfo>
Apr 12 09:13:03 user nova-compute[71482]:   <os>
Apr 12 09:13:03 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:13:03 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:13:03 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:13:03 user nova-compute[71482]:   </os>
Apr 12 09:13:03 user nova-compute[71482]:   <features>
Apr 12 09:13:03 user nova-compute[71482]:     <acpi/>
Apr 12 09:13:03 user nova-compute[71482]:     <apic/>
Apr 12 09:13:03 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:13:03 user nova-compute[71482]:   </features>
Apr 12 09:13:03 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:13:03 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:13:03 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:13:03 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:13:03 user nova-compute[71482]:   </clock>
Apr 12 09:13:03 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:13:03 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:13:03 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:13:03 user nova-compute[71482]:   </cpu>
Apr 12 09:13:03 user nova-compute[71482]:   <devices>
Apr 12 09:13:03 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:13:03 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:13:03 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk"/>
Apr 12 09:13:03 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:13:03 user nova-compute[71482]:     </disk>
Apr 12 09:13:03 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:13:03 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:13:03 user nova-compute[71482]:       <source dev="/dev/sdd"/>
Apr 12 09:13:03 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:13:03 user nova-compute[71482]:       <serial>95e901df-9a3a-4145-a12e-c77232853864</serial>
Apr 12 09:13:03 user nova-compute[71482]:     </disk>
Apr 12 09:13:03 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:13:03 user nova-compute[71482]:       <mac address="fa:16:3e:9b:4e:53"/>
Apr 12 09:13:03 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:13:03 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:13:03 user nova-compute[71482]:       <target dev="tapdc64c2a8-53"/>
Apr 12 09:13:03 user nova-compute[71482]:     </interface>
Apr 12 09:13:03 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:13:03 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/console.log" append="off"/>
Apr 12 09:13:03 user nova-compute[71482]:     </serial>
Apr 12 09:13:03 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:13:03 user nova-compute[71482]:     <video>
Apr 12 09:13:03 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:13:03 user nova-compute[71482]:     </video>
Apr 12 09:13:03 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:13:03 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:13:03 user nova-compute[71482]:     </rng>
Apr 12 09:13:03 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:13:03 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:13:03 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:13:03 user nova-compute[71482]:     </memballoon>
Apr 12 09:13:03 user nova-compute[71482]:   </devices>
Apr 12 09:13:03 user nova-compute[71482]: </domain>
Apr 12 09:13:03 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:12:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG os_vif [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc64c2a8-53, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc64c2a8-53, col_values=(('external_ids', {'iface-id': 'dc64c2a8-533c-40df-b88e-c059cb9cda89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:4e:53', 'vm-uuid': '4f211820-161b-4bef-b25d-ced137325da1'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:03 user nova-compute[71482]: INFO os_vif [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53')
Apr 12 09:13:03 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290783.0100296, f683bc12-8fca-47de-b28e-a0070e77b387 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:13:03 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] VM Started (Lifecycle Event)
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:13:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No VIF found with MAC fa:16:3e:9b:4e:53, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:13:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:04 user nova-compute[71482]: WARNING nova.compute.manager [req-ec7bea6e-9469-494f-a249-ee94bb795ec0 req-795a9c50-3426-4905-8c69-6ef93818f1aa service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 09:13:05 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290770.342406, 4f211820-161b-4bef-b25d-ced137325da1 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:13:05 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Stopped (Lifecycle Event)
Apr 12 09:13:05 user nova-compute[71482]: DEBUG nova.compute.manager [None req-caf37e6b-766b-4759-941e-4541d8c45fa6 None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:06 user nova-compute[71482]: WARNING nova.compute.manager [req-558eecf7-d94e-4076-a404-05c923538f17 req-f3067e0d-6e69-4824-a45d-73be46bb0b21 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state rebuild_spawning.
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290787.0148664, 4f211820-161b-4bef-b25d-ced137325da1 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:13:07 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Resumed (Lifecycle Event)
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:13:07 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance spawned successfully.
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:13:07 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290787.0194871, 4f211820-161b-4bef-b25d-ced137325da1 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:13:07 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Started (Lifecycle Event)
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:13:07 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG nova.objects.instance [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71482) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-14a64554-6a98-498a-82b9-39a4a3af3ae8 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:28 user nova-compute[71482]: INFO nova.compute.manager [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Rescuing
Apr 12 09:13:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:13:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquired lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:13:28 user nova-compute[71482]: DEBUG nova.network.neutron [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updating instance_info_cache with network_info: [{"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Releasing lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-unplugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-unplugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:29 user nova-compute[71482]: WARNING nova.compute.manager [req-43b85c9f-4150-4765-bc40-1b79aa47cecf req-c23053f5-156d-4ec9-b86f-ce9bcdb66485 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-unplugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state active and task_state rescuing.
Apr 12 09:13:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Instance destroyed successfully.
Apr 12 09:13:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Attempting a stable device rescue
Apr 12 09:13:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Instance directory exists: not creating {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 09:13:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Creating image(s)
Apr 12 09:13:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "/opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "/opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG nova.objects.instance [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'trusted_certs' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8.part --force-share --output=json" returned: 0 in 0.172s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:30 user nova-compute[71482]: DEBUG nova.virt.images [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] fa1c2236-9e5d-4388-bbf1-aefd42468884 was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:13:30 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:13:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8.part /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8.part /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8.converted" returned: 0 in 0.270s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.393s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.compute.manager [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.compute.manager [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:31 user nova-compute[71482]: WARNING nova.compute.manager [req-a256491e-96fa-4970-83f7-0e6a416b22af req-0c6ebb35-5f4b-4174-883f-85183c8c6cc4 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state active and task_state rescuing.
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8 --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8,backing_fmt=raw /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8,backing_fmt=raw /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue" returned: 0 in 0.050s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.objects.instance [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'migration_context' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Start _get_guest_xml network_info=[{"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "vif_mac": "fa:16:3e:77:49:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fa1c2236-9e5d-4388-bbf1-aefd42468884', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'bb8ed7d1-d2a4-41b6-a8c6-7480d1ff0513', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGLmXMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e2070294-eb8a-4ee9-a4b5-baab508d8744', 'attached_at': '', 'detached_at': '', 'volume_id': '4192d3db-69e0-430c-a44a-27c9d897c4ae', 'serial': '4192d3db-69e0-430c-a44a-27c9d897c4ae'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.objects.instance [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'resources' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.objects.instance [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'numa_topology' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:31 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:13:31 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.objects.instance [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'vcpu_model' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGLmXMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:13:31 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:13:31 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:13:31 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de75c01-2523-4373-af90-39d2f4bbc3c7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = uvGLmXMJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 09:13:31 user nova-compute[71482]: node.name = iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:13:31 user nova-compute[71482]: node.tpgt = -1
Apr 12 09:13:31 user nova-compute[71482]: node.startup = automatic
Apr 12 09:13:31 user nova-compute[71482]: node.leading_login = No
Apr 12 09:13:31 user nova-compute[71482]: iface.iscsi_ifacename = default
Apr 12 09:13:31 user nova-compute[71482]: iface.net_ifacename = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.ipaddress = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.prefix_len = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.hwaddress = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.transport_name = tcp
Apr 12 09:13:31 user nova-compute[71482]: iface.initiatorname = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.state = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.vlan_id = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.vlan_priority = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.vlan_state = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.iface_num = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.mtu = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.port = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.bootproto = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.subnet_mask = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.gateway = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.dhcp_alt_client_id = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.dhcp_dns = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.dhcp_learn_iqn = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.dhcp_vendor_id_state = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.dhcp_vendor_id = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.dhcp_slp_da = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.fragmentation = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.gratuitous_arp = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.incoming_forwarding = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.tos_state = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.tos = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.ttl = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.delayed_ack = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.tcp_nagle = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.tcp_wsf_state = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.tcp_wsf = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.tcp_timer_scale = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.tcp_timestamp = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.redirect = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.def_task_mgmt_timeout = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.header_digest = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.data_digest = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.immediate_data = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.initial_r2t = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.data_seq_inorder = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.data_pdu_inorder = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.erl = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.max_receive_data_len = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.first_burst_len = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.max_outstanding_r2t = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.max_burst_len = 0
Apr 12 09:13:31 user nova-compute[71482]: iface.chap_auth = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.bidi_chap = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.strict_login_compliance = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.discovery_auth = <empty>
Apr 12 09:13:31 user nova-compute[71482]: iface.discovery_logout = <empty>
Apr 12 09:13:31 user nova-compute[71482]: node.discovery_address = <empty>
Apr 12 09:13:31 user nova-compute[71482]: node.discovery_port = 0
Apr 12 09:13:31 user nova-compute[71482]: node.discovery_type = static
Apr 12 09:13:31 user nova-compute[71482]: node.session.initial_cmdsn = 0
Apr 12 09:13:31 user nova-compute[71482]: node.session.initial_login_retry_max = 8
Apr 12 09:13:31 user nova-compute[71482]: node.session.xmit_thread_priority = -20
Apr 12 09:13:31 user nova-compute[71482]: node.session.cmds_max = 128
Apr 12 09:13:31 user nova-compute[71482]: node.session.queue_depth = 32
Apr 12 09:13:31 user nova-compute[71482]: node.session.nr_sessions = 1
Apr 12 09:13:31 user nova-compute[71482]: node.session.auth.authmethod = CHAP
Apr 12 09:13:31 user nova-compute[71482]: node.session.auth.username = uvGLmXMJ
Apr 12 09:13:31 user nova-compute[71482]: node.session.auth.password = ***
Apr 12 09:13:31 user nova-compute[71482]: node.session.auth.username_in = <empty>
Apr 12 09:13:31 user nova-compute[71482]: node.session.auth.password_in = <empty>
Apr 12 09:13:31 user nova-compute[71482]: node.session.auth.chap_algs = MD5
Apr 12 09:13:31 user nova-compute[71482]: node.session.timeo.replacement_timeout = 120
Apr 12 09:13:31 user nova-compute[71482]: node.session.err_timeo.abort_timeout = 15
Apr 12 09:13:31 user nova-compute[71482]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 09:13:31 user nova-compute[71482]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 09:13:31 user nova-compute[71482]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.FastAbort = Yes
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.InitialR2T = No
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.ImmediateData = Yes
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.MaxConnections = 1
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 09:13:31 user nova-compute[71482]: node.session.iscsi.ERL = 0
Apr 12 09:13:31 user nova-compute[71482]: node.session.scan = manual
Apr 12 09:13:31 user nova-compute[71482]: node.session.reopen_max = 0
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].address = 172.16.0.220
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].port = 3260
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].startup = manual
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].tcp.window_size = 524288
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].tcp.type_of_service = 0
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].timeo.logout_timeout = 15
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].timeo.login_timeout = 15
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].timeo.auth_timeout = 45
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].iscsi.DataDigest = None
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].iscsi.IFMarker = No
Apr 12 09:13:31 user nova-compute[71482]: node.conn[0].iscsi.OFMarker = No
Apr 12 09:13:31 user nova-compute[71482]: # END RECORD
Apr 12 09:13:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ef5be9-8a69-498a-89f0-17fc30f4cf55]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7949f3-a4c5-451f-bce5-2bec0fa05ed6]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvGLmXMJ {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvGLmXMJ" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff96eba-c6cd-4599-a426-8c8c6b46d36b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvGLmXMJ'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3c8809-540d-4dd9-aba8-14d9adfb6e23]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8fa7db-26d3-4bc0-aff4-21e834ac7fe7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:13:31 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:13:31 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:13:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:13:31 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:13:31 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:13:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] HCTL ('34', '0', '0', 0) found on session 11 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9919626-c5fe-43a7-85d4-8d3ed76b1d1e]: (4, ('0 0 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Searching for a device in session 11 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGLmXMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.209s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] <== connect_volume: return (210ms) {'type': 'block', 'scsi_wwn': '26464383365316439', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464383365316439', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1955348970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1955348970',id=12,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:11:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-e5mpec81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:11:55Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=e2070294-eb8a-4ee9-a4b5-baab508d8744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "vif_mac": "fa:16:3e:77:49:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "vif_mac": "fa:16:3e:77:49:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c417659-5031-44dd-9796-062033960cc6,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c417659-50') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.objects.instance [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'pci_devices' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:13:31 user nova-compute[71482]:   <uuid>e2070294-eb8a-4ee9-a4b5-baab508d8744</uuid>
Apr 12 09:13:31 user nova-compute[71482]:   <name>instance-0000000c</name>
Apr 12 09:13:31 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:13:31 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:13:31 user nova-compute[71482]:   <metadata>
Apr 12 09:13:31 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:13:31 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:13:31 user nova-compute[71482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1955348970</nova:name>
Apr 12 09:13:31 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:13:31</nova:creationTime>
Apr 12 09:13:31 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:13:31 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:13:31 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:13:31 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:13:31 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:13:31 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:13:31 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:13:31 user nova-compute[71482]:       <nova:owner>
Apr 12 09:13:31 user nova-compute[71482]:         <nova:user uuid="cc51704e74b045ad9733a43aec982390">tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member</nova:user>
Apr 12 09:13:31 user nova-compute[71482]:         <nova:project uuid="a6ce4a0f4dad40c18fd8a83470c15f05">tempest-ServerBootFromVolumeStableRescueTest-1244466684</nova:project>
Apr 12 09:13:31 user nova-compute[71482]:       </nova:owner>
Apr 12 09:13:31 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:13:31 user nova-compute[71482]:       <nova:ports>
Apr 12 09:13:31 user nova-compute[71482]:         <nova:port uuid="2c417659-5031-44dd-9796-062033960cc6">
Apr 12 09:13:31 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:13:31 user nova-compute[71482]:         </nova:port>
Apr 12 09:13:31 user nova-compute[71482]:       </nova:ports>
Apr 12 09:13:31 user nova-compute[71482]:     </nova:instance>
Apr 12 09:13:31 user nova-compute[71482]:   </metadata>
Apr 12 09:13:31 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:13:31 user nova-compute[71482]:     <system>
Apr 12 09:13:31 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:13:31 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:13:31 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:13:31 user nova-compute[71482]:       <entry name="serial">e2070294-eb8a-4ee9-a4b5-baab508d8744</entry>
Apr 12 09:13:31 user nova-compute[71482]:       <entry name="uuid">e2070294-eb8a-4ee9-a4b5-baab508d8744</entry>
Apr 12 09:13:31 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:13:31 user nova-compute[71482]:     </system>
Apr 12 09:13:31 user nova-compute[71482]:   </sysinfo>
Apr 12 09:13:31 user nova-compute[71482]:   <os>
Apr 12 09:13:31 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:13:31 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:13:31 user nova-compute[71482]:   </os>
Apr 12 09:13:31 user nova-compute[71482]:   <features>
Apr 12 09:13:31 user nova-compute[71482]:     <acpi/>
Apr 12 09:13:31 user nova-compute[71482]:     <apic/>
Apr 12 09:13:31 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:13:31 user nova-compute[71482]:   </features>
Apr 12 09:13:31 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:13:31 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:13:31 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:13:31 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:13:31 user nova-compute[71482]:   </clock>
Apr 12 09:13:31 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:13:31 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:13:31 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:13:31 user nova-compute[71482]:   </cpu>
Apr 12 09:13:31 user nova-compute[71482]:   <devices>
Apr 12 09:13:31 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:13:31 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:13:31 user nova-compute[71482]:       <source dev="/dev/sdc"/>
Apr 12 09:13:31 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:13:31 user nova-compute[71482]:       <serial>4192d3db-69e0-430c-a44a-27c9d897c4ae</serial>
Apr 12 09:13:31 user nova-compute[71482]:     </disk>
Apr 12 09:13:31 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:13:31 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:13:31 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue"/>
Apr 12 09:13:31 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:13:31 user nova-compute[71482]:       <boot order="1"/>
Apr 12 09:13:31 user nova-compute[71482]:     </disk>
Apr 12 09:13:31 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:13:31 user nova-compute[71482]:       <mac address="fa:16:3e:77:49:9c"/>
Apr 12 09:13:31 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:13:31 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:13:31 user nova-compute[71482]:       <target dev="tap2c417659-50"/>
Apr 12 09:13:31 user nova-compute[71482]:     </interface>
Apr 12 09:13:31 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:13:31 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/console.log" append="off"/>
Apr 12 09:13:31 user nova-compute[71482]:     </serial>
Apr 12 09:13:31 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:13:31 user nova-compute[71482]:     <video>
Apr 12 09:13:31 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:13:31 user nova-compute[71482]:     </video>
Apr 12 09:13:31 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:13:31 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:13:31 user nova-compute[71482]:     </rng>
Apr 12 09:13:31 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:13:31 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:13:31 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:13:31 user nova-compute[71482]:     </memballoon>
Apr 12 09:13:31 user nova-compute[71482]:   </devices>
Apr 12 09:13:31 user nova-compute[71482]: </domain>
Apr 12 09:13:31 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:13:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Instance destroyed successfully.
Apr 12 09:13:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:13:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:13:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No VIF found with MAC fa:16:3e:77:49:9c, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:13:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:33 user nova-compute[71482]: WARNING nova.compute.manager [req-b4bfd593-3aa2-4ad1-be86-aa25a9061589 req-e266844b-496c-4943-9d15-c2d17fa9e9c4 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state active and task_state rescuing.
Apr 12 09:13:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:35 user nova-compute[71482]: WARNING nova.compute.manager [req-660269d2-66cc-437e-b4d1-d9da6bd66ce6 req-f7c7073f-4272-4d31-a873-f60e1f3c4985 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state active and task_state rescuing.
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for e2070294-eb8a-4ee9-a4b5-baab508d8744 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290815.8707151, e2070294-eb8a-4ee9-a4b5-baab508d8744 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:13:35 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] VM Resumed (Lifecycle Event)
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-74e7ba57-e819-4c2e-a0e0-bc3bb6228d03 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:13:35 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290815.8727732, e2070294-eb8a-4ee9-a4b5-baab508d8744 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:13:35 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] VM Started (Lifecycle Event)
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:13:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:13:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:13:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:13:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:13:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:13:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:13:42 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:13:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:43 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updating instance_info_cache with network_info: [{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:13:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:13:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:13:43 user nova-compute[71482]: INFO nova.compute.manager [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Rescuing
Apr 12 09:13:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:13:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquired lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:13:43 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:13:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:44 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:13:44 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:13:44 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updating instance_info_cache with network_info: [{"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:13:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Releasing lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:13:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-unplugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-unplugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:45 user nova-compute[71482]: WARNING nova.compute.manager [req-d5db3aa1-04a4-41fe-9fd2-11333f2dea46 req-2e1f963a-149c-48cb-a70b-24210d825f33 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-unplugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state active and task_state rescuing.
Apr 12 09:13:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance destroyed successfully.
Apr 12 09:13:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Attempting rescue
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance directory exists: not creating {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 09:13:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Creating image(s)
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue" returned: 0 in 0.063s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'migration_context' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Start _get_guest_xml network_info=[{"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "vif_mac": "fa:16:3e:4b:70:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'resources' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:45 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:13:45 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1294510131',display_name='tempest-ServerRescueNegativeTestJSON-server-1294510131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1294510131',id=4,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-fq7jpw7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:09:20Z,user_data=None,user_id='7f6b983634234693ba04a3097c2a129b',uuid=4a835849-83a7-457d-a96d-0acaa5a4a964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "vif_mac": "fa:16:3e:4b:70:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "vif_mac": "fa:16:3e:4b:70:8c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a9c92ca6-773e-40e3-ab31-710b4b495183,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c92ca6-77') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:13:45 user nova-compute[71482]:   <uuid>4a835849-83a7-457d-a96d-0acaa5a4a964</uuid>
Apr 12 09:13:45 user nova-compute[71482]:   <name>instance-00000004</name>
Apr 12 09:13:45 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:13:45 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:13:45 user nova-compute[71482]:   <metadata>
Apr 12 09:13:45 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:13:45 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:13:45 user nova-compute[71482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1294510131</nova:name>
Apr 12 09:13:45 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:13:45</nova:creationTime>
Apr 12 09:13:45 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:13:45 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:13:45 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:13:45 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:13:45 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:13:45 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:13:45 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:13:45 user nova-compute[71482]:       <nova:owner>
Apr 12 09:13:45 user nova-compute[71482]:         <nova:user uuid="7f6b983634234693ba04a3097c2a129b">tempest-ServerRescueNegativeTestJSON-480181232-project-member</nova:user>
Apr 12 09:13:45 user nova-compute[71482]:         <nova:project uuid="1c3cc8ab6ab244b1badb6fea347d64ea">tempest-ServerRescueNegativeTestJSON-480181232</nova:project>
Apr 12 09:13:45 user nova-compute[71482]:       </nova:owner>
Apr 12 09:13:45 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:13:45 user nova-compute[71482]:       <nova:ports>
Apr 12 09:13:45 user nova-compute[71482]:         <nova:port uuid="a9c92ca6-773e-40e3-ab31-710b4b495183">
Apr 12 09:13:45 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:13:45 user nova-compute[71482]:         </nova:port>
Apr 12 09:13:45 user nova-compute[71482]:       </nova:ports>
Apr 12 09:13:45 user nova-compute[71482]:     </nova:instance>
Apr 12 09:13:45 user nova-compute[71482]:   </metadata>
Apr 12 09:13:45 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:13:45 user nova-compute[71482]:     <system>
Apr 12 09:13:45 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:13:45 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:13:45 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:13:45 user nova-compute[71482]:       <entry name="serial">4a835849-83a7-457d-a96d-0acaa5a4a964</entry>
Apr 12 09:13:45 user nova-compute[71482]:       <entry name="uuid">4a835849-83a7-457d-a96d-0acaa5a4a964</entry>
Apr 12 09:13:45 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:13:45 user nova-compute[71482]:     </system>
Apr 12 09:13:45 user nova-compute[71482]:   </sysinfo>
Apr 12 09:13:45 user nova-compute[71482]:   <os>
Apr 12 09:13:45 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:13:45 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:13:45 user nova-compute[71482]:   </os>
Apr 12 09:13:45 user nova-compute[71482]:   <features>
Apr 12 09:13:45 user nova-compute[71482]:     <acpi/>
Apr 12 09:13:45 user nova-compute[71482]:     <apic/>
Apr 12 09:13:45 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:13:45 user nova-compute[71482]:   </features>
Apr 12 09:13:45 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:13:45 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:13:45 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:13:45 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:13:45 user nova-compute[71482]:   </clock>
Apr 12 09:13:45 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:13:45 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:13:45 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:13:45 user nova-compute[71482]:   </cpu>
Apr 12 09:13:45 user nova-compute[71482]:   <devices>
Apr 12 09:13:45 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:13:45 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:13:45 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue"/>
Apr 12 09:13:45 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:13:45 user nova-compute[71482]:     </disk>
Apr 12 09:13:45 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:13:45 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:13:45 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk"/>
Apr 12 09:13:45 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:13:45 user nova-compute[71482]:     </disk>
Apr 12 09:13:45 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:13:45 user nova-compute[71482]:       <mac address="fa:16:3e:4b:70:8c"/>
Apr 12 09:13:45 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:13:45 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:13:45 user nova-compute[71482]:       <target dev="tapa9c92ca6-77"/>
Apr 12 09:13:45 user nova-compute[71482]:     </interface>
Apr 12 09:13:45 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:13:45 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/console.log" append="off"/>
Apr 12 09:13:45 user nova-compute[71482]:     </serial>
Apr 12 09:13:45 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:13:45 user nova-compute[71482]:     <video>
Apr 12 09:13:45 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:13:45 user nova-compute[71482]:     </video>
Apr 12 09:13:45 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:13:45 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:13:45 user nova-compute[71482]:     </rng>
Apr 12 09:13:45 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:13:45 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:13:45 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:13:45 user nova-compute[71482]:     </memballoon>
Apr 12 09:13:45 user nova-compute[71482]:   </devices>
Apr 12 09:13:45 user nova-compute[71482]: </domain>
Apr 12 09:13:45 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:13:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance destroyed successfully.
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:13:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No VIF found with MAC fa:16:3e:4b:70:8c, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:13:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:13:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:13:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:47 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:13:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:47 user nova-compute[71482]: WARNING nova.compute.manager [req-72bb9f69-6196-48cf-b3aa-ab5de6034890 req-c72b380b-d3b2-4d45-a166-566f58f382d0 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state active and task_state rescuing.
Apr 12 09:13:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 4a835849-83a7-457d-a96d-0acaa5a4a964 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290829.0404785, 4a835849-83a7-457d-a96d-0acaa5a4a964 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:13:49 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] VM Resumed (Lifecycle Event)
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3e7c9c25-3234-45a8-9c90-4dab70a9d9f2 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:13:49 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290829.0418184, 4a835849-83a7-457d-a96d-0acaa5a4a964 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:13:49 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] VM Started (Lifecycle Event)
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:49 user nova-compute[71482]: WARNING nova.compute.manager [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state rescued and task_state None.
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:13:49 user nova-compute[71482]: WARNING nova.compute.manager [req-873b2c42-ba5d-4463-bb78-80399afc3d46 req-dba26e09-af95-4e00-8043-a50f16b96fb6 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state rescued and task_state None.
Apr 12 09:13:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:50 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:13:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue --force-share --output=json" returned: 0 in 0.164s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-changed-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Refreshing instance network info cache due to event network-changed-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] Acquiring lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] Acquired lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:13:53 user nova-compute[71482]: DEBUG nova.network.neutron [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Refreshing network info cache for port dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:13:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.network.neutron [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updated VIF entry in instance network info cache for port dd53e034-3c1a-4153-b8ba-fc9db5cfea0e. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.network.neutron [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updating instance_info_cache with network_info: [{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:13:55 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:13:55 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7685MB free_disk=26.353485107421875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bd9d396a-819d-4673-b9ae-b1156e5e274c req-3b0924da-df12-418c-9ab1-282005bbe99b service nova] Releasing lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:13:55 user nova-compute[71482]: INFO nova.compute.manager [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] instance snapshotting
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f683bc12-8fca-47de-b28e-a0070e77b387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a5e42339-50fa-411c-94a1-c350727b7955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f4a3ed65-d508-476d-975d-e8dceb64565a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:13:55 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Beginning live snapshot process
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json -f qcow2 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.594s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json -f qcow2" returned: 0 in 0.156s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json -f qcow2 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json -f qcow2" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.152s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd63gu8un/11cf1ba4e6274f3595ab0e64eb980962.delta 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpd63gu8un/11cf1ba4e6274f3595ab0e64eb980962.delta 1073741824" returned: 0 in 0.057s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:56 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 09:13:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:13:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:13:57 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 09:13:57 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:13:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd63gu8un/11cf1ba4e6274f3595ab0e64eb980962.delta /opt/stack/data/nova/instances/snapshots/tmpd63gu8un/11cf1ba4e6274f3595ab0e64eb980962 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:13:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:13:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpd63gu8un/11cf1ba4e6274f3595ab0e64eb980962.delta /opt/stack/data/nova/instances/snapshots/tmpd63gu8un/11cf1ba4e6274f3595ab0e64eb980962" returned: 0 in 0.632s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:13:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Snapshot extracted, beginning image upload
Apr 12 09:13:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Snapshot image upload complete
Apr 12 09:14:00 user nova-compute[71482]: INFO nova.compute.manager [None req-955e8e4b-7378-4025-a821-86ca7edde66a tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Took 5.44 seconds to snapshot the instance on the hypervisor.
Apr 12 09:14:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "f4a3ed65-d508-476d-975d-e8dceb64565a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:10 user nova-compute[71482]: INFO nova.compute.manager [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Terminating instance
Apr 12 09:14:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received event network-vif-unplugged-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] Acquiring lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] No waiting events found dispatching network-vif-unplugged-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-03c182ad-6c68-4529-a766-d6c14210b99c req-18d54a04-8af4-481b-bdaf-087a2a99a019 service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received event network-vif-unplugged-36f04153-f10f-4525-9dd6-35f943897a28 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:14:11 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Instance destroyed successfully.
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.objects.instance [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'resources' on Instance uuid f4a3ed65-d508-476d-975d-e8dceb64565a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-904443664',display_name='tempest-VolumesAdminNegativeTest-server-904443664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-904443664',id=14,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:12:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd9e7d6ece244a96b01277451a3ed5a5',ramdisk_id='',reservation_id='r-vxp51tpv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-588655718',owner_user_name='tempest-VolumesAdminNegativeTest-588655718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:12:23Z,user_data=None,user_id='8911ec7c959541989cce3870ba11fb80',uuid=f4a3ed65-d508-476d-975d-e8dceb64565a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converting VIF {"id": "36f04153-f10f-4525-9dd6-35f943897a28", "address": "fa:16:3e:9f:65:51", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36f04153-f1", "ovs_interfaceid": "36f04153-f10f-4525-9dd6-35f943897a28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:65:51,bridge_name='br-int',has_traffic_filtering=True,id=36f04153-f10f-4525-9dd6-35f943897a28,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04153-f1') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG os_vif [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:65:51,bridge_name='br-int',has_traffic_filtering=True,id=36f04153-f10f-4525-9dd6-35f943897a28,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04153-f1') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36f04153-f1, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:11 user nova-compute[71482]: INFO os_vif [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:65:51,bridge_name='br-int',has_traffic_filtering=True,id=36f04153-f10f-4525-9dd6-35f943897a28,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap36f04153-f1')
Apr 12 09:14:11 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Deleting instance files /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a_del
Apr 12 09:14:11 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Deletion of /opt/stack/data/nova/instances/f4a3ed65-d508-476d-975d-e8dceb64565a_del complete
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:14:11 user nova-compute[71482]: INFO nova.compute.claims [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Claim successful on node user
Apr 12 09:14:11 user nova-compute[71482]: INFO nova.compute.manager [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:14:11 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:14:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:14:11 user nova-compute[71482]: INFO nova.virt.block_device [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Booting with volume 2ba76717-8078-4e70-8674-985933f03801 at /dev/vda
Apr 12 09:14:11 user nova-compute[71482]: DEBUG os_brick.utils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de3f500-34cc-4d5d-9140-d6881bb32462]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe82e2d6-34ac-4afb-b95b-e93201192ae2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7558c66b-9b6f-4b28-bdf2-eab2822a787c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1692641e-4021-4afc-a2ce-53e75d283a7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:11 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:14:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03461105-ad5f-4873-81ef-8d15af315ee2]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG os_brick.utils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating existing volume attachment record: 0a3a728b-25d6-47e3-abcf-9444472b1759 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG nova.policy [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '614726429a894b9499267c0c533330b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7c759e2e974720a71b31ddbb2adba8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:14:12 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Took 1.03 seconds to deallocate network for instance.
Apr 12 09:14:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received event network-vif-plugged-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] Acquiring lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] No waiting events found dispatching network-vif-plugged-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:12 user nova-compute[71482]: WARNING nova.compute.manager [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received unexpected event network-vif-plugged-36f04153-f10f-4525-9dd6-35f943897a28 for instance with vm_state deleted and task_state None.
Apr 12 09:14:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-1a257bac-cb63-4cd7-8013-c08344e49536 req-f3bac925-9383-4382-976e-82b542d3784e service nova] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Received event network-vif-deleted-36f04153-f10f-4525-9dd6-35f943897a28 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:12 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Deleted allocations for instance f4a3ed65-d508-476d-975d-e8dceb64565a
Apr 12 09:14:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-68d6eca7-8604-4042-ae25-680275431d47 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "f4a3ed65-d508-476d-975d-e8dceb64565a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.630s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:13 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully created port: 8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:13 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully created port: d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:14 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully created port: 422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:14 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully created port: 69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:15 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully created port: 80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:15 user nova-compute[71482]: DEBUG nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:14:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:14:15 user nova-compute[71482]: INFO nova.compute.claims [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Claim successful on node user
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully updated port: 8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.compute.manager [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-changed-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.compute.manager [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing instance network info cache due to event network-changed-8403a9c1-5cfb-4f4a-bace-89f6a6130872. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] Acquiring lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] Acquired lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.network.neutron [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing network info cache for port 8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:16 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.network.neutron [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:14:16 user nova-compute[71482]: INFO nova.virt.block_device [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Booting with volume 7d7ff3a5-498a-4f2d-95b7-2a0e77950344 at /dev/vda
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.utils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe7e3f7-3ebf-403f-979d-120351980efa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[478f018b-b6d5-40bb-a920-aa04626fac07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0600e76c-541a-4b35-83c5-9c714d628c22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b5096-b4ec-428c-84bc-72ad878060de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.network.neutron [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-48c2207f-d90b-407c-bf7c-a7e4479b9723 req-226d220f-db41-4d5a-a312-bd7e14088d1d service nova] Releasing lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:16 user nova-compute[71482]: INFO nova.virt.block_device [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Booting with volume aebae2e1-26c4-4850-b330-67cd69d5afb6 at /dev/vdb
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:16 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b8e489-f91e-4cea-8979-35681cbfa9f5]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.utils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating existing volume attachment record: 233ad541-8758-422c-9227-4327eb59bb70 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.policy [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '40052fbebbb4401f89f591ca889b0cfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ce13a09e5b842b1997cee5123e0f167', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.utils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee355e9-4ce4-42ae-9f5b-80deff378433]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[12800dbe-8147-47a7-87fd-5af6c284d7c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a3771b-d19e-4672-b980-72f1963292d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce2b396-a191-4ab2-bf89-ec6a50d7a930]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:16 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:14:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3709f363-e4d8-485e-848f-ace0767f4958]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG os_brick.utils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:16 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating existing volume attachment record: d1a3c463-22a7-438c-99ae-26922333e2b4 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:14:17 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully updated port: 1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully created port: 01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-changed-1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing instance network info cache due to event network-changed-1de643f2-6b45-4ca5-92ca-057a72e44f63. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] Acquiring lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] Acquired lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing network info cache for port 1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-972ddfd8-6d49-4f38-a884-ba716a30af89 req-52182fb4-be90-4923-9dbf-ac6a33a926ea service nova] Releasing lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:19 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully updated port: 13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:19 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully created port: 0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-changed-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing instance network info cache due to event network-changed-13cd3fb5-aca8-4a53-ba4e-3e810c35e853. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] Acquiring lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] Acquired lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG nova.network.neutron [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing network info cache for port 13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG nova.network.neutron [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully updated port: d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG nova.network.neutron [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7d356c1a-b638-49f5-a06d-cf39c3e9c63d req-09af0404-45f6-45a2-b1cf-a29c6a234400 service nova] Releasing lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully created port: ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:20 user nova-compute[71482]: INFO nova.virt.block_device [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Booting with volume 91bd6c2d-ef3f-491f-904a-32510538ec83 at /dev/vdb
Apr 12 09:14:20 user nova-compute[71482]: DEBUG os_brick.utils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d8262c-5eb6-4591-a08d-e603984c0c8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[274cb96b-d74f-4c93-a852-de1b8e8d5bd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[26293cfa-7e80-4a1b-9716-4f735efb7e0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[feee7630-c652-469f-a642-a2756b4b1197]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:21 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9bca15-2ae3-486a-8b01-c43153334f75]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.utils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating existing volume attachment record: 92db2cd5-7cf4-416c-8fd1-246c1f48d5b5 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:21 user nova-compute[71482]: INFO nova.virt.block_device [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Booting with volume ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 at /dev/vdc
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.utils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca798ae7-536b-4374-ad45-f3932f68ba77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[51317a24-f692-421e-90a6-a943e7895e99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[97459152-e169-4d4d-b807-57b4f6908353]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d38f06c-c15e-4308-b0cf-ce59e513deec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:21 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:14:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d75b89d-7482-42f2-b3d7-c2d343392528]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG os_brick.utils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:21 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating existing volume attachment record: 08e9ffc3-df85-40ef-a2ff-bcaed85af4fb {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully updated port: 422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully created port: f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-changed-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing instance network info cache due to event network-changed-d221807b-9715-4917-99a5-eecefd100946. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Acquiring lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Acquired lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing network info cache for port d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Releasing lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-changed-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing instance network info cache due to event network-changed-422290f4-824f-41ca-9a75-8031d21416a5. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Acquiring lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Acquired lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing network info cache for port 422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bbe83366-4589-418c-8eac-3b1c3b01045f req-fdcb8ef9-4de9-42fe-b120-36ad5f28e353 service nova] Releasing lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully updated port: 69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully created port: be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:14:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-changed-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing instance network info cache due to event network-changed-69ed460b-cbfb-4ab2-9008-58b16a554e4a. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] Acquiring lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] Acquired lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:24 user nova-compute[71482]: DEBUG nova.network.neutron [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing network info cache for port 69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:24 user nova-compute[71482]: DEBUG nova.network.neutron [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:24 user nova-compute[71482]: DEBUG nova.network.neutron [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-51c894ea-5ccd-4d0e-aa47-658bc7859b48 req-6ad4cb81-1b34-49b5-abe9-4ed543e2bc59 service nova] Releasing lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:25 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Successfully updated port: 80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquired lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:25 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:14:25 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully updated port: 01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:25 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:25 user nova-compute[71482]: INFO nova.virt.block_device [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Booting with volume df849839-f09e-44e6-8d36-832c074c558e at /dev/vdc
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:14:26 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Creating image(s)
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Ensure instance console log exists: /opt/stack/data/nova/instances/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG os_brick.utils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290851.0880015, f4a3ed65-d508-476d-975d-e8dceb64565a => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:14:26 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] VM Stopped (Lifecycle Event)
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03be6a5-f06b-4393-a00d-2fbe5c4badd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a0c062b0-5d91-4191-b750-dadac4b03425 None None] [instance: f4a3ed65-d508-476d-975d-e8dceb64565a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1d2b1e-c5ef-446a-b370-95fa83559daa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9983f57c-a128-4dfa-9d6d-516b65a1a429]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1914ca5f-785a-46b9-9008-57b3917a4930]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:26 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[68caf6e4-36f1-45b5-93c0-228e6e572b49]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG os_brick.utils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating existing volume attachment record: 62eb6812-8039-48d1-80b5-50fe069bc2de {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-changed-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing instance network info cache due to event network-changed-80680073-3437-4be0-bf87-9ab62eb1320a. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Acquiring lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:26 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully updated port: 8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:28 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully updated port: 9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-changed-8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing instance network info cache due to event network-changed-8e85632b-0047-4c19-8d7a-745e21a1bb97. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Acquiring lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Acquired lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:28 user nova-compute[71482]: DEBUG nova.network.neutron [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing network info cache for port 8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [{"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Releasing lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance network_info: |[{"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Acquired lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing network info cache for port 80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Start _get_guest_xml network_info=[{"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0a3a728b-25d6-47e3-abcf-9444472b1759', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiScTGXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c', 'attached_at': '', 'detached_at': '', 'volume_id': '2ba76717-8078-4e70-8674-985933f03801', 'serial': '2ba76717-8078-4e70-8674-985933f03801'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'attachment_id': 'd1a3c463-22a7-438c-99ae-26922333e2b4', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzOaMpdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c', 'attached_at': '', 'detached_at': '', 'volume_id': 'aebae2e1-26c4-4850-b330-67cd69d5afb6', 'serial': 'aebae2e1-26c4-4850-b330-67cd69d5afb6'}, 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'attachment_id': '08e9ffc3-df85-40ef-a2ff-bcaed85af4fb', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qidDRhjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce66f1cf-2d13-4309-b3d7-3a48dcd60b20', 'serial': 'ce66f1cf-2d13-4309-b3d7-3a48dcd60b20'}, 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:14:29 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:14:29 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiScTGXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:29 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:29 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:29 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fc965f-96c8-48a2-b2b8-d991c015a6bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:14:29 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8397d17-2a39-46fb-aeb2-c2a37f1d97a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801] added
Apr 12 09:14:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f035dc-04ec-4235-ad2b-be31282a3e6b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b510a38b-4810-4a42-a5dd-315013246a17]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiScTGXL {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tiScTGXL" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3649e6-002e-4455-9a9e-8afa3f8579f7]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tiScTGXL'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c063e9-d641-428d-ac87-9a0896443b24]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[192c4344-e8a0-4556-a4fd-eea46282521d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Releasing lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-changed-9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing instance network info cache due to event network-changed-9f3437a2-863d-44c4-8d16-29e58aadf676. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Acquiring lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Acquired lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing network info cache for port 9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a10ee7-28d5-48da-88e8-44007473be49]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801, portal: 172.16.0.220,3260]
Apr 12 09:14:29 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801, portal: 172.16.0.220,3260] successful.
Apr 12 09:14:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8507edd2-74cd-4969-821a-951be937f49b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d322582-e678-420a-b977-90760ae30f44]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7ef734-8ef2-48a3-a3e8-a6f9ee93a9bd]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiScTGXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-15754785-7472-40a6-b6cb-c3357b3fad58 req-997feb7b-f86b-4a39-83bb-6a1bc3f1c243 service nova] Releasing lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updated VIF entry in instance network info cache for port 80680073-3437-4be0-bf87-9ab62eb1320a. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [{"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully updated port: 0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Releasing lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-changed-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing instance network info cache due to event network-changed-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Acquiring lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Acquired lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing network info cache for port 01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG nova.network.neutron [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74c3f628-6297-4f6f-880d-b07160ee2086 req-375c0c79-e315-4c61-be2b-f8862448cd58 service nova] Releasing lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '26665653639663132', 'path': '/dev/sde'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665653639663132', 'path': '/dev/sde'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzOaMpdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:30 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:30 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:30 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5c8df3-1592-4475-9ad6-448f29ac713e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:14:30 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5059791-c863-4a68-9a44-3747c6a9fc3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6] added
Apr 12 09:14:30 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a19636-6363-4a87-b5b5-977ec637e301]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.058s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[791a530e-0754-4cf2-8cc7-cf75e7b436d1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzOaMpdn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-changed-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing instance network info cache due to event network-changed-0a6649c3-bb81-4507-8666-3d78390b0579. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] Acquiring lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] Acquired lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG nova.network.neutron [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing network info cache for port 0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully updated port: ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UzOaMpdn" returned: 0 in 0.139s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[da28f3bf-0ab0-44fd-9eee-d8a1f0ed51f1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UzOaMpdn'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccb1ad4-9c9a-4ead-9608-048683a8a0f1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG nova.network.neutron [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cd4c91-1018-4a49-8a2e-e27e76379daa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.126s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f421204e-3d12-4dfc-87e5-97aecc583a82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6, portal: 172.16.0.220,3260]
Apr 12 09:14:31 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6, portal: 172.16.0.220,3260] successful.
Apr 12 09:14:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f93fb0-06fd-48a3-b55b-3e9b384a0233]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG nova.network.neutron [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d1322493-a0b4-4a67-84b8-32f0610fc4b3 req-60b52169-bb36-44d3-8abb-0b83e91ff5a5 service nova] Releasing lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9917b4-d9b1-4503-8cb9-a099266b7e78]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.738s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] HCTL ('37', '-', '-', 0) found on session 16 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a96f2b7-50b0-44d3-98e5-a95f9b47f373]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Searching for a device in session 16 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzOaMpdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:14:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Creating image(s)
Apr 12 09:14:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Ensure instance console log exists: /opt/stack/data/nova/instances/6f800d18-d86c-4d82-9bb8-ce480c8835aa/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:31 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully updated port: f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.774s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] <== connect_volume: return (1776ms) {'type': 'block', 'scsi_wwn': '26462373530613531', 'path': '/dev/sdf'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462373530613531', 'path': '/dev/sdf'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qidDRhjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:32 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:32 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:32 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[086a479e-85de-42d8-b908-8e964ab318a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:14:32 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3761e314-b4a4-468c-b07c-911c86f50b97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20] added
Apr 12 09:14:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[679cffa4-60e4-430e-a5a1-80abaff9f99c]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ced8d5-ab6c-433c-8397-15ce361c2483]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qidDRhjm {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qidDRhjm" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b93c9cb-ee39-48e8-a6b3-a029958dc07f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qidDRhjm'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdb06d5-b700-4eaf-8c85-111b6b6a6d4f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7237aa9f-ab33-4961-9ee1-63300dda0164]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Successfully updated port: be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquired lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d40e402-9977-4d43-9f40-9165eb1fc348]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20, portal: 172.16.0.220,3260]
Apr 12 09:14:32 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20, portal: 172.16.0.220,3260] successful.
Apr 12 09:14:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa545174-24bc-42fe-9253-3b5a43ebaf88]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cf6514-3ab1-424f-b019-d258b6ef094f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1aede0-50d9-489e-ae3a-251f5f827ee8]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qidDRhjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-changed-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing instance network info cache due to event network-changed-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Acquiring lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23339346232373361', 'path': '/dev/sdg'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339346232373361', 'path': '/dev/sdg'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:d6:73,bridge_name='br-int',has_traffic_filtering=True,id=8403a9c1-5cfb-4f4a-bace-89f6a6130872,network=Network(49518285-f6aa-449f-ab1b-f86fb262a325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8403a9c1-5c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b3:ba,bridge_name='br-int',has_traffic_filtering=True,id=1de643f2-6b45-4ca5-92ca-057a72e44f63,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1de643f2-6b') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:47:b1,bridge_name='br-int',has_traffic_filtering=True,id=13cd3fb5-aca8-4a53-ba4e-3e810c35e853,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cd3fb5-ac') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=d221807b-9715-4917-99a5-eecefd100946,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd221807b-97') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5f:09,bridge_name='br-int',has_traffic_filtering=True,id=422290f4-824f-41ca-9a75-8031d21416a5,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422290f4-82') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c5:d9,bridge_name='br-int',has_traffic_filtering=True,id=69ed460b-cbfb-4ab2-9008-58b16a554e4a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ed460b-cb') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:45:70,bridge_name='br-int',has_traffic_filtering=True,id=80680073-3437-4be0-bf87-9ab62eb1320a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80680073-34') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lazy-loading 'pci_devices' on Instance uuid a4d42e71-e21f-465d-b0a1-7cc5dbe0494c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:14:33 user nova-compute[71482]:   <uuid>a4d42e71-e21f-465d-b0a1-7cc5dbe0494c</uuid>
Apr 12 09:14:33 user nova-compute[71482]:   <name>instance-00000010</name>
Apr 12 09:14:33 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:14:33 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:14:33 user nova-compute[71482]:   <metadata>
Apr 12 09:14:33 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:14:33 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:14:33 user nova-compute[71482]:       <nova:name>tempest-device-tagging-server-957238113</nova:name>
Apr 12 09:14:33 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:14:29</nova:creationTime>
Apr 12 09:14:33 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:14:33 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:14:33 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:14:33 user nova-compute[71482]:       <nova:owner>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:user uuid="614726429a894b9499267c0c533330b8">tempest-TaggedBootDevicesTest_v242-683378533-project-member</nova:user>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:project uuid="fa7c759e2e974720a71b31ddbb2adba8">tempest-TaggedBootDevicesTest_v242-683378533</nova:project>
Apr 12 09:14:33 user nova-compute[71482]:       </nova:owner>
Apr 12 09:14:33 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:14:33 user nova-compute[71482]:       <nova:ports>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:port uuid="8403a9c1-5cfb-4f4a-bace-89f6a6130872">
Apr 12 09:14:33 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 09:14:33 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:port uuid="1de643f2-6b45-4ca5-92ca-057a72e44f63">
Apr 12 09:14:33 user nova-compute[71482]:           <nova:ip type="fixed" address="10.1.1.243" ipVersion="4"/>
Apr 12 09:14:33 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:port uuid="13cd3fb5-aca8-4a53-ba4e-3e810c35e853">
Apr 12 09:14:33 user nova-compute[71482]:           <nova:ip type="fixed" address="10.1.1.77" ipVersion="4"/>
Apr 12 09:14:33 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:port uuid="d221807b-9715-4917-99a5-eecefd100946">
Apr 12 09:14:33 user nova-compute[71482]:           <nova:ip type="fixed" address="10.1.1.190" ipVersion="4"/>
Apr 12 09:14:33 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:port uuid="422290f4-824f-41ca-9a75-8031d21416a5">
Apr 12 09:14:33 user nova-compute[71482]:           <nova:ip type="fixed" address="10.1.1.171" ipVersion="4"/>
Apr 12 09:14:33 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:port uuid="69ed460b-cbfb-4ab2-9008-58b16a554e4a">
Apr 12 09:14:33 user nova-compute[71482]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 09:14:33 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:33 user nova-compute[71482]:         <nova:port uuid="80680073-3437-4be0-bf87-9ab62eb1320a">
Apr 12 09:14:33 user nova-compute[71482]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 09:14:33 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:33 user nova-compute[71482]:       </nova:ports>
Apr 12 09:14:33 user nova-compute[71482]:     </nova:instance>
Apr 12 09:14:33 user nova-compute[71482]:   </metadata>
Apr 12 09:14:33 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:14:33 user nova-compute[71482]:     <system>
Apr 12 09:14:33 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:14:33 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:14:33 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:14:33 user nova-compute[71482]:       <entry name="serial">a4d42e71-e21f-465d-b0a1-7cc5dbe0494c</entry>
Apr 12 09:14:33 user nova-compute[71482]:       <entry name="uuid">a4d42e71-e21f-465d-b0a1-7cc5dbe0494c</entry>
Apr 12 09:14:33 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:14:33 user nova-compute[71482]:     </system>
Apr 12 09:14:33 user nova-compute[71482]:   </sysinfo>
Apr 12 09:14:33 user nova-compute[71482]:   <os>
Apr 12 09:14:33 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:14:33 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:14:33 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:14:33 user nova-compute[71482]:   </os>
Apr 12 09:14:33 user nova-compute[71482]:   <features>
Apr 12 09:14:33 user nova-compute[71482]:     <acpi/>
Apr 12 09:14:33 user nova-compute[71482]:     <apic/>
Apr 12 09:14:33 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:14:33 user nova-compute[71482]:   </features>
Apr 12 09:14:33 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:14:33 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:14:33 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:14:33 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:14:33 user nova-compute[71482]:   </clock>
Apr 12 09:14:33 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:14:33 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:14:33 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:14:33 user nova-compute[71482]:   </cpu>
Apr 12 09:14:33 user nova-compute[71482]:   <devices>
Apr 12 09:14:33 user nova-compute[71482]:     <disk type="file" device="cdrom">
Apr 12 09:14:33 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 09:14:33 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/disk.config"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="hda" bus="ide"/>
Apr 12 09:14:33 user nova-compute[71482]:     </disk>
Apr 12 09:14:33 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:14:33 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:33 user nova-compute[71482]:       <source dev="/dev/sde"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <serial>2ba76717-8078-4e70-8674-985933f03801</serial>
Apr 12 09:14:33 user nova-compute[71482]:     </disk>
Apr 12 09:14:33 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:14:33 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:33 user nova-compute[71482]:       <source dev="/dev/sdf"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <serial>aebae2e1-26c4-4850-b330-67cd69d5afb6</serial>
Apr 12 09:14:33 user nova-compute[71482]:     </disk>
Apr 12 09:14:33 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:14:33 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:33 user nova-compute[71482]:       <source dev="/dev/sdg"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="vdc" bus="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <serial>ce66f1cf-2d13-4309-b3d7-3a48dcd60b20</serial>
Apr 12 09:14:33 user nova-compute[71482]:     </disk>
Apr 12 09:14:33 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:33 user nova-compute[71482]:       <mac address="fa:16:3e:1b:d6:73"/>
Apr 12 09:14:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="tap8403a9c1-5c"/>
Apr 12 09:14:33 user nova-compute[71482]:     </interface>
Apr 12 09:14:33 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:33 user nova-compute[71482]:       <mac address="fa:16:3e:11:b3:ba"/>
Apr 12 09:14:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="tap1de643f2-6b"/>
Apr 12 09:14:33 user nova-compute[71482]:     </interface>
Apr 12 09:14:33 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:33 user nova-compute[71482]:       <mac address="fa:16:3e:5d:47:b1"/>
Apr 12 09:14:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="tap13cd3fb5-ac"/>
Apr 12 09:14:33 user nova-compute[71482]:     </interface>
Apr 12 09:14:33 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:33 user nova-compute[71482]:       <mac address="fa:16:3e:0a:2c:f8"/>
Apr 12 09:14:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="tapd221807b-97"/>
Apr 12 09:14:33 user nova-compute[71482]:     </interface>
Apr 12 09:14:33 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:33 user nova-compute[71482]:       <mac address="fa:16:3e:87:5f:09"/>
Apr 12 09:14:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="tap422290f4-82"/>
Apr 12 09:14:33 user nova-compute[71482]:     </interface>
Apr 12 09:14:33 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:33 user nova-compute[71482]:       <mac address="fa:16:3e:ae:c5:d9"/>
Apr 12 09:14:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="tap69ed460b-cb"/>
Apr 12 09:14:33 user nova-compute[71482]:     </interface>
Apr 12 09:14:33 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:33 user nova-compute[71482]:       <mac address="fa:16:3e:80:45:70"/>
Apr 12 09:14:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:33 user nova-compute[71482]:       <target dev="tap80680073-34"/>
Apr 12 09:14:33 user nova-compute[71482]:     </interface>
Apr 12 09:14:33 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:14:33 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/console.log" append="off"/>
Apr 12 09:14:33 user nova-compute[71482]:     </serial>
Apr 12 09:14:33 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:14:33 user nova-compute[71482]:     <video>
Apr 12 09:14:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:33 user nova-compute[71482]:     </video>
Apr 12 09:14:33 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:14:33 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:14:33 user nova-compute[71482]:     </rng>
Apr 12 09:14:33 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:14:33 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:14:33 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:14:33 user nova-compute[71482]:     </memballoon>
Apr 12 09:14:33 user nova-compute[71482]:   </devices>
Apr 12 09:14:33 user nova-compute[71482]: </domain>
Apr 12 09:14:33 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:d6:73,bridge_name='br-int',has_traffic_filtering=True,id=8403a9c1-5cfb-4f4a-bace-89f6a6130872,network=Network(49518285-f6aa-449f-ab1b-f86fb262a325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8403a9c1-5c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:d6:73,bridge_name='br-int',has_traffic_filtering=True,id=8403a9c1-5cfb-4f4a-bace-89f6a6130872,network=Network(49518285-f6aa-449f-ab1b-f86fb262a325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8403a9c1-5c') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8403a9c1-5c, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8403a9c1-5c, col_values=(('external_ids', {'iface-id': '8403a9c1-5cfb-4f4a-bace-89f6a6130872', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:d6:73', 'vm-uuid': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: INFO os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:d6:73,bridge_name='br-int',has_traffic_filtering=True,id=8403a9c1-5cfb-4f4a-bace-89f6a6130872,network=Network(49518285-f6aa-449f-ab1b-f86fb262a325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8403a9c1-5c')
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b3:ba,bridge_name='br-int',has_traffic_filtering=True,id=1de643f2-6b45-4ca5-92ca-057a72e44f63,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1de643f2-6b') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b3:ba,bridge_name='br-int',has_traffic_filtering=True,id=1de643f2-6b45-4ca5-92ca-057a72e44f63,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1de643f2-6b') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1de643f2-6b, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1de643f2-6b, col_values=(('external_ids', {'iface-id': '1de643f2-6b45-4ca5-92ca-057a72e44f63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:b3:ba', 'vm-uuid': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: INFO os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b3:ba,bridge_name='br-int',has_traffic_filtering=True,id=1de643f2-6b45-4ca5-92ca-057a72e44f63,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1de643f2-6b')
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:47:b1,bridge_name='br-int',has_traffic_filtering=True,id=13cd3fb5-aca8-4a53-ba4e-3e810c35e853,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cd3fb5-ac') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:47:b1,bridge_name='br-int',has_traffic_filtering=True,id=13cd3fb5-aca8-4a53-ba4e-3e810c35e853,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cd3fb5-ac') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13cd3fb5-ac, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13cd3fb5-ac, col_values=(('external_ids', {'iface-id': '13cd3fb5-aca8-4a53-ba4e-3e810c35e853', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:47:b1', 'vm-uuid': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: INFO os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:47:b1,bridge_name='br-int',has_traffic_filtering=True,id=13cd3fb5-aca8-4a53-ba4e-3e810c35e853,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cd3fb5-ac')
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=d221807b-9715-4917-99a5-eecefd100946,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd221807b-97') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=d221807b-9715-4917-99a5-eecefd100946,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd221807b-97') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd221807b-97, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd221807b-97, col_values=(('external_ids', {'iface-id': 'd221807b-9715-4917-99a5-eecefd100946', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:2c:f8', 'vm-uuid': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: INFO os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=d221807b-9715-4917-99a5-eecefd100946,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd221807b-97')
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5f:09,bridge_name='br-int',has_traffic_filtering=True,id=422290f4-824f-41ca-9a75-8031d21416a5,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422290f4-82') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5f:09,bridge_name='br-int',has_traffic_filtering=True,id=422290f4-824f-41ca-9a75-8031d21416a5,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422290f4-82') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap422290f4-82, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap422290f4-82, col_values=(('external_ids', {'iface-id': '422290f4-824f-41ca-9a75-8031d21416a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:5f:09', 'vm-uuid': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: INFO os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5f:09,bridge_name='br-int',has_traffic_filtering=True,id=422290f4-824f-41ca-9a75-8031d21416a5,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422290f4-82')
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c5:d9,bridge_name='br-int',has_traffic_filtering=True,id=69ed460b-cbfb-4ab2-9008-58b16a554e4a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ed460b-cb') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c5:d9,bridge_name='br-int',has_traffic_filtering=True,id=69ed460b-cbfb-4ab2-9008-58b16a554e4a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ed460b-cb') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69ed460b-cb, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69ed460b-cb, col_values=(('external_ids', {'iface-id': '69ed460b-cbfb-4ab2-9008-58b16a554e4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:c5:d9', 'vm-uuid': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:34 user nova-compute[71482]: INFO os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c5:d9,bridge_name='br-int',has_traffic_filtering=True,id=69ed460b-cbfb-4ab2-9008-58b16a554e4a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ed460b-cb')
Apr 12 09:14:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:45:70,bridge_name='br-int',has_traffic_filtering=True,id=80680073-3437-4be0-bf87-9ab62eb1320a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80680073-34') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:45:70,bridge_name='br-int',has_traffic_filtering=True,id=80680073-3437-4be0-bf87-9ab62eb1320a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80680073-34') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80680073-34, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80680073-34, col_values=(('external_ids', {'iface-id': '80680073-3437-4be0-bf87-9ab62eb1320a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:45:70', 'vm-uuid': 'a4d42e71-e21f-465d-b0a1-7cc5dbe0494c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:34 user nova-compute[71482]: INFO os_vif [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:45:70,bridge_name='br-int',has_traffic_filtering=True,id=80680073-3437-4be0-bf87-9ab62eb1320a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80680073-34')
Apr 12 09:14:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] No BDM found with device name hda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] No VIF found with MAC fa:16:3e:1b:d6:73, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] No VIF found with MAC fa:16:3e:87:5f:09, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:14:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Using config drive
Apr 12 09:14:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Creating config drive at /opt/stack/data/nova/instances/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/disk.config
Apr 12 09:14:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyn5cky8g {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpyn5cky8g" returned: 0 in 0.056s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:34 user nova-compute[71482]: DEBUG nova.network.neutron [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Releasing lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Instance network_info: |[{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Acquired lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing network info cache for port ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Start _get_guest_xml network_info=[{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '233ad541-8758-422c-9227-4327eb59bb70', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HehbcwkP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f800d18-d86c-4d82-9bb8-ce480c8835aa', 'attached_at': '', 'detached_at': '', 'volume_id': '7d7ff3a5-498a-4f2d-95b7-2a0e77950344', 'serial': '7d7ff3a5-498a-4f2d-95b7-2a0e77950344'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None}, {'attachment_id': '92db2cd5-7cf4-416c-8fd1-246c1f48d5b5', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGZylXUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f800d18-d86c-4d82-9bb8-ce480c8835aa', 'attached_at': '', 'detached_at': '', 'volume_id': '91bd6c2d-ef3f-491f-904a-32510538ec83', 'serial': '91bd6c2d-ef3f-491f-904a-32510538ec83'}, 'device_type': 'disk', 'boot_index': 1, 'volume_type': None}, {'attachment_id': '62eb6812-8039-48d1-80b5-50fe069bc2de', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWURkLYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6f800d18-d86c-4d82-9bb8-ce480c8835aa', 'attached_at': '', 'detached_at': '', 'volume_id': 'df849839-f09e-44e6-8d36-832c074c558e', 'serial': 'df849839-f09e-44e6-8d36-832c074c558e'}, 'device_type': 'disk', 'boot_index': 2, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:14:35 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:14:35 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HehbcwkP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:35 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:35 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:35 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a98931-8cd7-4b02-b605-81ae40b23646]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:14:35 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c045a8ec-aa8f-4fa7-ad26-9bb573de4d20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344] added
Apr 12 09:14:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.053s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca82aab-9f4f-422f-84a6-391a3d7ce5a0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[946f61dc-56a8-4f82-b801-697d37ed1b81]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HehbcwkP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HehbcwkP" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaedcfd-2aac-4c26-95f2-c4c38ed89297]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HehbcwkP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[377f24ec-c57c-4705-8bc0-709123a4b5e8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[851d807c-ca1b-4ee8-a92c-caa601267c3a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbbb69d-df44-4552-9b44-3e54535664f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344, portal: 172.16.0.220,3260]
Apr 12 09:14:35 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344, portal: 172.16.0.220,3260] successful.
Apr 12 09:14:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0507399d-8f82-4b95-91d9-4ca81a4e355a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updated VIF entry in instance network info cache for port ebada7ae-e22b-4447-b0c2-ceccd02aa6bd. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[57629755-1ff3-493d-9d92-f72f2a825e37]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] HCTL ('39', '-', '-', 0) found on session 18 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Releasing lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-changed-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing instance network info cache due to event network-changed-f4d0c163-2589-499a-8da8-68891a344baf. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Acquiring lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Acquired lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing network info cache for port f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0396905e-3ec4-4111-8f00-191916d3a39c]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Searching for a device in session 18 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HehbcwkP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updated VIF entry in instance network info cache for port f4d0c163-2589-499a-8da8-68891a344baf. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Releasing lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-changed-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing instance network info cache due to event network-changed-be9408ea-445a-400a-a479-2c948b0e2a90. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Acquiring lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Acquired lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing network info cache for port be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:36 user nova-compute[71482]: WARNING nova.compute.manager [req-8173011b-a8be-4af3-85bc-c647a915204c req-2b7daf9b-00ea-4d4a-be23-aa81b511bf43 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance with vm_state building and task_state spawning.
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23238313737343661', 'path': '/dev/sdh'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238313737343661', 'path': '/dev/sdh'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGZylXUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:36 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:36 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:36 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4576c710-769a-410b-9942-dbcb3c34df1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:14:36 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:36 user nova-compute[71482]: WARNING nova.compute.manager [req-126c3d79-278c-444f-b6ab-ba8f7ddeb6f4 req-4aa59c66-c2aa-4539-ad96-fb48fc5a0ee7 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 for instance with vm_state building and task_state spawning.
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a3d436-002f-4225-88a1-6649651af070]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83] added
Apr 12 09:14:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0f03d5-a9df-4c2e-88b3-cff267d9efc8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c1e8a5-6af9-4234-aa29-4604b2d10469]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGZylXUF {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bGZylXUF" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8ad5fe-f453-4bfc-a1d7-16b8ed293065]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bGZylXUF'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c1a930-60ba-4db1-8604-accd3c25d607]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6912e2-6aa6-461c-9672-0db5bc645eb2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updated VIF entry in instance network info cache for port be9408ea-445a-400a-a479-2c948b0e2a90. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[967c89b2-8f92-4a4a-929a-24503e32c2c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83, portal: 172.16.0.220,3260]
Apr 12 09:14:36 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83, portal: 172.16.0.220,3260] successful.
Apr 12 09:14:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8925813d-0960-45df-a456-74fe2b1d0ca8 req-95d477e3-d823-406b-98e1-096529677923 service nova] Releasing lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbcabe9-1fe2-460d-9f0d-7d0d48c98f71]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe3b248-4980-417c-a952-0f9ad06ad45e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] HCTL ('40', '-', '-', 0) found on session 19 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c1ce03-eef6-42a6-b79d-6c44e298e95b]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Searching for a device in session 19 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:14:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGZylXUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:37 user nova-compute[71482]: WARNING nova.compute.manager [req-01346ff8-19ef-4f74-a424-85eebbc0eb46 req-d33a40a8-dbaf-4fca-9f50-cbdf16f2a558 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-422290f4-824f-41ca-9a75-8031d21416a5 for instance with vm_state building and task_state spawning.
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23530326235353765', 'path': '/dev/sdi'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530326235353765', 'path': '/dev/sdi'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:14:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWURkLYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:38 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d37aeca-78e3-4372-b9e6-e35527a934ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:14:38 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd8162-21a8-4207-9ca6-accfac31805b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e] added
Apr 12 09:14:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f121363-6f22-44b8-bd0f-2c2996b4539d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b76b8d-7f3d-4871-b68e-0b3576f38198]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JWURkLYi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JWURkLYi" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83e1445-26ba-4196-ae95-9216ab21952a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JWURkLYi'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6617719-3e88-4cb6-af4a-f2eef4f78af0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86065d4-5460-4453-8dce-8cc208c41c48]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance with vm_state building and task_state spawning.
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 for instance with vm_state building and task_state spawning.
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 for instance with vm_state building and task_state spawning.
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance with vm_state building and task_state spawning.
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING nova.compute.manager [req-dba6504c-3589-4d99-96e1-86a05836f871 req-43ad86b8-a76f-49d5-aedf-b995ff9118d4 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance with vm_state building and task_state spawning.
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe1e944-711b-4a55-8b39-50009746fd61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e, portal: 172.16.0.220,3260]
Apr 12 09:14:38 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e, portal: 172.16.0.220,3260] successful.
Apr 12 09:14:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f72324-8855-4e4c-afff-a89abfb007c9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba85c68b-0092-487c-82f2-2ef6a1d1594d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:38 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] HCTL ('41', '-', '-', 0) found on session 20 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[58747d25-efc8-4f2c-9cdb-b6e7692798e3]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Searching for a device in session 20 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWURkLYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING nova.compute.manager [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 for instance with vm_state building and task_state spawning.
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING nova.compute.manager [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-d221807b-9715-4917-99a5-eecefd100946 for instance with vm_state building and task_state spawning.
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:38 user nova-compute[71482]: WARNING nova.compute.manager [req-2cab34ef-f899-402d-9ff3-c2bc198d4619 req-85c61c39-40bc-40bc-9510-f4ca3182f144 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-d221807b-9715-4917-99a5-eecefd100946 for instance with vm_state building and task_state spawning.
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26264363836613464', 'path': '/dev/sdj'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264363836613464', 'path': '/dev/sdj'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:09:79,bridge_name='br-int',has_traffic_filtering=True,id=01bd698c-51c6-4aa0-963c-6e12f8b2a5ff,network=Network(b85c5e98-acc1-431c-896a-2f20a3e0387b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bd698c-51') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e85632b-0047-4c19-8d7a-745e21a1bb97,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8e85632b-00') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4e:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f3437a2-863d-44c4-8d16-29e58aadf676,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f3437a2-86') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=0a6649c3-bb81-4507-8666-3d78390b0579,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6649c3-bb') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0f:a1,bridge_name='br-int',has_traffic_filtering=True,id=ebada7ae-e22b-4447-b0c2-ceccd02aa6bd,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebada7ae-e2') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=f4d0c163-2589-499a-8da8-68891a344baf,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d0c163-25') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:75,bridge_name='br-int',has_traffic_filtering=True,id=be9408ea-445a-400a-a479-2c948b0e2a90,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9408ea-44') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.objects.instance [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f800d18-d86c-4d82-9bb8-ce480c8835aa {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:14:39 user nova-compute[71482]:   <uuid>6f800d18-d86c-4d82-9bb8-ce480c8835aa</uuid>
Apr 12 09:14:39 user nova-compute[71482]:   <name>instance-00000011</name>
Apr 12 09:14:39 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:14:39 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:14:39 user nova-compute[71482]:   <metadata>
Apr 12 09:14:39 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:14:39 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:14:39 user nova-compute[71482]:       <nova:name>tempest-device-tagging-server-721191578</nova:name>
Apr 12 09:14:39 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:14:35</nova:creationTime>
Apr 12 09:14:39 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:14:39 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:14:39 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:14:39 user nova-compute[71482]:       <nova:owner>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:user uuid="40052fbebbb4401f89f591ca889b0cfa">tempest-TaggedBootDevicesTest-1718738212-project-member</nova:user>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:project uuid="5ce13a09e5b842b1997cee5123e0f167">tempest-TaggedBootDevicesTest-1718738212</nova:project>
Apr 12 09:14:39 user nova-compute[71482]:       </nova:owner>
Apr 12 09:14:39 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:14:39 user nova-compute[71482]:       <nova:ports>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:port uuid="01bd698c-51c6-4aa0-963c-6e12f8b2a5ff">
Apr 12 09:14:39 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 12 09:14:39 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:port uuid="8e85632b-0047-4c19-8d7a-745e21a1bb97">
Apr 12 09:14:39 user nova-compute[71482]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Apr 12 09:14:39 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:port uuid="9f3437a2-863d-44c4-8d16-29e58aadf676">
Apr 12 09:14:39 user nova-compute[71482]:           <nova:ip type="fixed" address="10.1.1.127" ipVersion="4"/>
Apr 12 09:14:39 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:port uuid="0a6649c3-bb81-4507-8666-3d78390b0579">
Apr 12 09:14:39 user nova-compute[71482]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Apr 12 09:14:39 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:port uuid="ebada7ae-e22b-4447-b0c2-ceccd02aa6bd">
Apr 12 09:14:39 user nova-compute[71482]:           <nova:ip type="fixed" address="10.1.1.112" ipVersion="4"/>
Apr 12 09:14:39 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:port uuid="f4d0c163-2589-499a-8da8-68891a344baf">
Apr 12 09:14:39 user nova-compute[71482]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 12 09:14:39 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:39 user nova-compute[71482]:         <nova:port uuid="be9408ea-445a-400a-a479-2c948b0e2a90">
Apr 12 09:14:39 user nova-compute[71482]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 12 09:14:39 user nova-compute[71482]:         </nova:port>
Apr 12 09:14:39 user nova-compute[71482]:       </nova:ports>
Apr 12 09:14:39 user nova-compute[71482]:     </nova:instance>
Apr 12 09:14:39 user nova-compute[71482]:   </metadata>
Apr 12 09:14:39 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:14:39 user nova-compute[71482]:     <system>
Apr 12 09:14:39 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:14:39 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:14:39 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:14:39 user nova-compute[71482]:       <entry name="serial">6f800d18-d86c-4d82-9bb8-ce480c8835aa</entry>
Apr 12 09:14:39 user nova-compute[71482]:       <entry name="uuid">6f800d18-d86c-4d82-9bb8-ce480c8835aa</entry>
Apr 12 09:14:39 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:14:39 user nova-compute[71482]:     </system>
Apr 12 09:14:39 user nova-compute[71482]:   </sysinfo>
Apr 12 09:14:39 user nova-compute[71482]:   <os>
Apr 12 09:14:39 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:14:39 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:14:39 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:14:39 user nova-compute[71482]:   </os>
Apr 12 09:14:39 user nova-compute[71482]:   <features>
Apr 12 09:14:39 user nova-compute[71482]:     <acpi/>
Apr 12 09:14:39 user nova-compute[71482]:     <apic/>
Apr 12 09:14:39 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:14:39 user nova-compute[71482]:   </features>
Apr 12 09:14:39 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:14:39 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:14:39 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:14:39 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:14:39 user nova-compute[71482]:   </clock>
Apr 12 09:14:39 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:14:39 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:14:39 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:14:39 user nova-compute[71482]:   </cpu>
Apr 12 09:14:39 user nova-compute[71482]:   <devices>
Apr 12 09:14:39 user nova-compute[71482]:     <disk type="file" device="cdrom">
Apr 12 09:14:39 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none"/>
Apr 12 09:14:39 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/6f800d18-d86c-4d82-9bb8-ce480c8835aa/disk.config"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="hda" bus="ide"/>
Apr 12 09:14:39 user nova-compute[71482]:     </disk>
Apr 12 09:14:39 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:14:39 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:39 user nova-compute[71482]:       <source dev="/dev/sdh"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <serial>7d7ff3a5-498a-4f2d-95b7-2a0e77950344</serial>
Apr 12 09:14:39 user nova-compute[71482]:     </disk>
Apr 12 09:14:39 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:14:39 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:39 user nova-compute[71482]:       <source dev="/dev/sdi"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <serial>91bd6c2d-ef3f-491f-904a-32510538ec83</serial>
Apr 12 09:14:39 user nova-compute[71482]:     </disk>
Apr 12 09:14:39 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:14:39 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:39 user nova-compute[71482]:       <source dev="/dev/sdj"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="vdc" bus="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <serial>df849839-f09e-44e6-8d36-832c074c558e</serial>
Apr 12 09:14:39 user nova-compute[71482]:     </disk>
Apr 12 09:14:39 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:39 user nova-compute[71482]:       <mac address="fa:16:3e:26:09:79"/>
Apr 12 09:14:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="tap01bd698c-51"/>
Apr 12 09:14:39 user nova-compute[71482]:     </interface>
Apr 12 09:14:39 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:39 user nova-compute[71482]:       <mac address="fa:16:3e:b3:d3:78"/>
Apr 12 09:14:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="tap8e85632b-00"/>
Apr 12 09:14:39 user nova-compute[71482]:     </interface>
Apr 12 09:14:39 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:39 user nova-compute[71482]:       <mac address="fa:16:3e:ef:4e:8e"/>
Apr 12 09:14:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="tap9f3437a2-86"/>
Apr 12 09:14:39 user nova-compute[71482]:     </interface>
Apr 12 09:14:39 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:39 user nova-compute[71482]:       <mac address="fa:16:3e:63:af:3c"/>
Apr 12 09:14:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="tap0a6649c3-bb"/>
Apr 12 09:14:39 user nova-compute[71482]:     </interface>
Apr 12 09:14:39 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:39 user nova-compute[71482]:       <mac address="fa:16:3e:d1:0f:a1"/>
Apr 12 09:14:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="tapebada7ae-e2"/>
Apr 12 09:14:39 user nova-compute[71482]:     </interface>
Apr 12 09:14:39 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:39 user nova-compute[71482]:       <mac address="fa:16:3e:10:2a:53"/>
Apr 12 09:14:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="tapf4d0c163-25"/>
Apr 12 09:14:39 user nova-compute[71482]:     </interface>
Apr 12 09:14:39 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:14:39 user nova-compute[71482]:       <mac address="fa:16:3e:e1:6f:75"/>
Apr 12 09:14:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:14:39 user nova-compute[71482]:       <target dev="tapbe9408ea-44"/>
Apr 12 09:14:39 user nova-compute[71482]:     </interface>
Apr 12 09:14:39 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:14:39 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/6f800d18-d86c-4d82-9bb8-ce480c8835aa/console.log" append="off"/>
Apr 12 09:14:39 user nova-compute[71482]:     </serial>
Apr 12 09:14:39 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:14:39 user nova-compute[71482]:     <video>
Apr 12 09:14:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:14:39 user nova-compute[71482]:     </video>
Apr 12 09:14:39 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:14:39 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:14:39 user nova-compute[71482]:     </rng>
Apr 12 09:14:39 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:14:39 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:14:39 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:14:39 user nova-compute[71482]:     </memballoon>
Apr 12 09:14:39 user nova-compute[71482]:   </devices>
Apr 12 09:14:39 user nova-compute[71482]: </domain>
Apr 12 09:14:39 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:09:79,bridge_name='br-int',has_traffic_filtering=True,id=01bd698c-51c6-4aa0-963c-6e12f8b2a5ff,network=Network(b85c5e98-acc1-431c-896a-2f20a3e0387b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bd698c-51') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:09:79,bridge_name='br-int',has_traffic_filtering=True,id=01bd698c-51c6-4aa0-963c-6e12f8b2a5ff,network=Network(b85c5e98-acc1-431c-896a-2f20a3e0387b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bd698c-51') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01bd698c-51, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01bd698c-51, col_values=(('external_ids', {'iface-id': '01bd698c-51c6-4aa0-963c-6e12f8b2a5ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:09:79', 'vm-uuid': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: INFO os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:09:79,bridge_name='br-int',has_traffic_filtering=True,id=01bd698c-51c6-4aa0-963c-6e12f8b2a5ff,network=Network(b85c5e98-acc1-431c-896a-2f20a3e0387b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bd698c-51')
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e85632b-0047-4c19-8d7a-745e21a1bb97,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8e85632b-00') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e85632b-0047-4c19-8d7a-745e21a1bb97,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8e85632b-00') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e85632b-00, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e85632b-00, col_values=(('external_ids', {'iface-id': '8e85632b-0047-4c19-8d7a-745e21a1bb97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:d3:78', 'vm-uuid': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: INFO os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e85632b-0047-4c19-8d7a-745e21a1bb97,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8e85632b-00')
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4e:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f3437a2-863d-44c4-8d16-29e58aadf676,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f3437a2-86') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4e:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f3437a2-863d-44c4-8d16-29e58aadf676,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f3437a2-86') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f3437a2-86, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f3437a2-86, col_values=(('external_ids', {'iface-id': '9f3437a2-863d-44c4-8d16-29e58aadf676', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:4e:8e', 'vm-uuid': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:39 user nova-compute[71482]: WARNING nova.compute.manager [req-354f00f6-212c-4f5b-a6ed-893dd4b88a41 req-c17edca1-8c49-41ff-83ca-9a2aa2941873 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-422290f4-824f-41ca-9a75-8031d21416a5 for instance with vm_state building and task_state spawning.
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: INFO os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4e:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f3437a2-863d-44c4-8d16-29e58aadf676,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f3437a2-86')
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=0a6649c3-bb81-4507-8666-3d78390b0579,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6649c3-bb') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=0a6649c3-bb81-4507-8666-3d78390b0579,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6649c3-bb') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a6649c3-bb, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0a6649c3-bb, col_values=(('external_ids', {'iface-id': '0a6649c3-bb81-4507-8666-3d78390b0579', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:af:3c', 'vm-uuid': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: INFO os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=0a6649c3-bb81-4507-8666-3d78390b0579,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6649c3-bb')
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0f:a1,bridge_name='br-int',has_traffic_filtering=True,id=ebada7ae-e22b-4447-b0c2-ceccd02aa6bd,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebada7ae-e2') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0f:a1,bridge_name='br-int',has_traffic_filtering=True,id=ebada7ae-e22b-4447-b0c2-ceccd02aa6bd,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebada7ae-e2') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebada7ae-e2, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebada7ae-e2, col_values=(('external_ids', {'iface-id': 'ebada7ae-e22b-4447-b0c2-ceccd02aa6bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:0f:a1', 'vm-uuid': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: INFO os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0f:a1,bridge_name='br-int',has_traffic_filtering=True,id=ebada7ae-e22b-4447-b0c2-ceccd02aa6bd,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebada7ae-e2')
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=f4d0c163-2589-499a-8da8-68891a344baf,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d0c163-25') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=f4d0c163-2589-499a-8da8-68891a344baf,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d0c163-25') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4d0c163-25, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4d0c163-25, col_values=(('external_ids', {'iface-id': 'f4d0c163-2589-499a-8da8-68891a344baf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:2a:53', 'vm-uuid': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: INFO os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=f4d0c163-2589-499a-8da8-68891a344baf,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d0c163-25')
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:75,bridge_name='br-int',has_traffic_filtering=True,id=be9408ea-445a-400a-a479-2c948b0e2a90,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9408ea-44') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:75,bridge_name='br-int',has_traffic_filtering=True,id=be9408ea-445a-400a-a479-2c948b0e2a90,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9408ea-44') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe9408ea-44, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe9408ea-44, col_values=(('external_ids', {'iface-id': 'be9408ea-445a-400a-a479-2c948b0e2a90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:6f:75', 'vm-uuid': '6f800d18-d86c-4d82-9bb8-ce480c8835aa'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.objects.instance [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'flavor' on Instance uuid 3872dcd7-8f2e-4b6e-9450-f8939143a94d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:39 user nova-compute[71482]: INFO os_vif [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:75,bridge_name='br-int',has_traffic_filtering=True,id=be9408ea-445a-400a-a479-2c948b0e2a90,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9408ea-44')
Apr 12 09:14:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] No BDM found with device name hda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] No VIF found with MAC fa:16:3e:26:09:79, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] No VIF found with MAC fa:16:3e:d1:0f:a1, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:14:39 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Using config drive
Apr 12 09:14:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:39 user nova-compute[71482]: INFO nova.compute.manager [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Attaching volume 236d694a-0b00-4b38-8770-54a0485d8b56 to /dev/vdb
Apr 12 09:14:40 user nova-compute[71482]: DEBUG os_brick.utils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df15150-0216-4da8-b524-c6f373227b2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Creating config drive at /opt/stack/data/nova/instances/6f800d18-d86c-4d82-9bb8-ce480c8835aa/disk.config
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6f800d18-d86c-4d82-9bb8-ce480c8835aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphzj6rvkm {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfe6d8b-434a-4698-b90c-0a800581f7f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290880.1183932, a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:14:40 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] VM Resumed (Lifecycle Event)
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d598abac-a66d-4c78-84bd-b89b3c4ae416]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance spawned successfully.
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6f800d18-d86c-4d82-9bb8-ce480c8835aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphzj6rvkm" returned: 0 in 0.062s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a4d64b-62a0-4436-a3dd-cec0aaabba31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:14:40 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bf38ee-7715-4817-a1cf-4d64d3adfbe3]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG os_brick.utils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Updating existing volume attachment record: c1db160d-58ee-40c7-95ca-c58c19cd5a84 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:40 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290880.120356, a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:14:40 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] VM Started (Lifecycle Event)
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:40 user nova-compute[71482]: WARNING nova.compute.manager [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-80680073-3437-4be0-bf87-9ab62eb1320a for instance with vm_state building and task_state spawning.
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:40 user nova-compute[71482]: WARNING nova.compute.manager [req-0c8265ec-8082-4f0d-89d9-80c3abec9e06 req-5db84403-7eb7-4975-8244-4489ba6c7154 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-80680073-3437-4be0-bf87-9ab62eb1320a for instance with vm_state building and task_state spawning.
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:14:40 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:14:40 user nova-compute[71482]: INFO nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Took 14.52 seconds to spawn the instance on the hypervisor.
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:14:40 user nova-compute[71482]: INFO nova.compute.manager [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Took 29.54 seconds to build instance.
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adfbcd60-d6c5-4838-a170-d14496e6febb tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.657s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received event network-changed-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Refreshing instance network info cache due to event network-changed-cbba3d0e-337f-4f59-90b6-6216192cdb3b. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] Acquiring lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] Acquired lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:40 user nova-compute[71482]: DEBUG nova.network.neutron [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Refreshing network info cache for port cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:14:41 user nova-compute[71482]: DEBUG nova.network.neutron [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Updated VIF entry in instance network info cache for port cbba3d0e-337f-4f59-90b6-6216192cdb3b. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:14:41 user nova-compute[71482]: DEBUG nova.network.neutron [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Updating instance_info_cache with network_info: [{"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d9fcb411-cc8c-499d-b643-4e2906180abb req-9f7fb81f-801f-417b-b9a2-df51dc8d56ad service nova] Releasing lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:42 user nova-compute[71482]: WARNING nova.compute.manager [req-0411edb5-ec17-4e16-9e7c-9789f4fd0e55 req-343415a8-0ced-4dd9-aa03-8a4324139b2f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 for instance with vm_state building and task_state spawning.
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:42 user nova-compute[71482]: WARNING nova.compute.manager [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance with vm_state building and task_state spawning.
Apr 12 09:14:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:42 user nova-compute[71482]: WARNING nova.compute.manager [req-75a862de-a3f2-4578-9cef-c5ce9714abf9 req-d09af83b-921f-4183-b049-a1f80600c2e9 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance with vm_state building and task_state spawning.
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:42 user nova-compute[71482]: WARNING nova.compute.manager [req-0353cd4e-b115-4159-8c77-5293685eb4c8 req-c462ff3e-f93d-4c80-840b-6be310f5535b service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-0a6649c3-bb81-4507-8666-3d78390b0579 for instance with vm_state building and task_state spawning.
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: INFO nova.compute.manager [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Detaching volume a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:14:44 user nova-compute[71482]: INFO nova.virt.block_device [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Attempting to driver detach volume a058b665-da02-444b-8e77-862141ce3a61 from mountpoint /dev/vdb
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Attempting to detach device vdb from instance f683bc12-8fca-47de-b28e-a0070e77b387 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:14:44 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:44 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:14:44 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:14:44 user nova-compute[71482]:   <serial>a058b665-da02-444b-8e77-862141ce3a61</serial>
Apr 12 09:14:44 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 09:14:44 user nova-compute[71482]: </disk>
Apr 12 09:14:44 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:14:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully detached device vdb from instance f683bc12-8fca-47de-b28e-a0070e77b387 from the persistent domain config.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f683bc12-8fca-47de-b28e-a0070e77b387 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:14:44 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:44 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:14:44 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:14:44 user nova-compute[71482]:   <serial>a058b665-da02-444b-8e77-862141ce3a61</serial>
Apr 12 09:14:44 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 09:14:44 user nova-compute[71482]: </disk>
Apr 12 09:14:44 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-9f3437a2-863d-44c4-8d16-29e58aadf676 for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-9f3437a2-863d-44c4-8d16-29e58aadf676 for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-f4d0c163-2589-499a-8da8-68891a344baf for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-630d9f9d-bf55-4efc-ab07-331431bd84f1 req-4164e977-100c-463d-a8a7-47f2f02e4fe7 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-f4d0c163-2589-499a-8da8-68891a344baf for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-be9408ea-445a-400a-a479-2c948b0e2a90 for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-6581e38a-bdfa-47d9-a9e1-11465ed5de0b req-39643c01-2886-4906-a044-2cca01b3a20f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-be9408ea-445a-400a-a479-2c948b0e2a90 for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681290884.888966, f683bc12-8fca-47de-b28e-a0070e77b387 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:14:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully detached device vdb from instance f683bc12-8fca-47de-b28e-a0070e77b387 from the live domain config.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PWzKUNkr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-0a6649c3-bb81-4507-8666-3d78390b0579 for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:44 user nova-compute[71482]: WARNING nova.compute.manager [req-6611b218-83f6-412b-9b50-dc4c26b135f0 req-06efa548-c0d9-420b-b388-c2be4bf6bf80 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance with vm_state building and task_state spawning.
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6636819b-e028-4cfc-8609-765330f67b80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:14:44 user nova-compute[71482]: No targets found.
Apr 12 09:14:44 user nova-compute[71482]: iSNS:
Apr 12 09:14:44 user nova-compute[71482]: No targets found.
Apr 12 09:14:44 user nova-compute[71482]: STATIC:
Apr 12 09:14:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864
Apr 12 09:14:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e
Apr 12 09:14:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6
Apr 12 09:14:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344
Apr 12 09:14:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801
Apr 12 09:14:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83
Apr 12 09:14:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20
Apr 12 09:14:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:14:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61
Apr 12 09:14:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:44 user nova-compute[71482]: FIRMWARE:
Apr 12 09:14:44 user nova-compute[71482]: No targets found.
Apr 12 09:14:44 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:14:44 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:14:44 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2747bf11-e630-45af-b2f9-45f991d3fa06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e74e70d-f3c6-4993-9407-506cdf48239c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f934436ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fab57f-f617-4976-8252-ed25bb57abbf]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9295367d-ee66-4ead-85b3-8193e6e66f93]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45501c9f-69c6-46fb-b778-c9a03efab332]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.075s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2cb527-2d58-4df1-94aa-bece136f06e6]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a3eea8-4778-4a93-b1db-6e8d41156428]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[972c33c9-36be-4ebc-8716-376cdde16381]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260]
Apr 12 09:14:45 user nova-compute[71482]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61, portal: 172.16.0.220,3260] successful.
Apr 12 09:14:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcvdoQUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:45 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a058b665-da02-444b-8e77-862141ce3a61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6241bd-4f4c-4384-881e-c338227a8f2a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.439s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== disconnect_volume: return (441ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.059s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:45 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:45 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd543c-2f10-4dcb-8db4-4ec13509db0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:14:45 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbfefa9-7506-4fd2-8177-c143642b601d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56] added
Apr 12 09:14:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e52ba8-927c-43fb-9321-d7efc27979c1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ecb6db9-353a-4b5a-9371-902c73db46d4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TcvdoQUk {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TcvdoQUk" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8436c5d8-8099-4112-a7b4-6fcf8ae4f23e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TcvdoQUk'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c22245-6430-49f4-bc20-a7bac31080ee]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9788e56-a42c-4639-89cd-d5d1ffba3def]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --login" returned: 0 in 0.114s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[279ac1c2-88bb-4036-9e23-05f044fe5278]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56, portal: 172.16.0.220,3260]
Apr 12 09:14:45 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56, portal: 172.16.0.220,3260] successful.
Apr 12 09:14:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f38e3c-c307-478c-bea7-033f0141dd42]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fea91d-4e65-43c4-8ed9-b87be8dc5000]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:45 user nova-compute[71482]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 (non-flash)
Apr 12 09:14:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c56ccb-0ccb-45c9-95bc-18c328cc4303]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:14:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcvdoQUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290886.1534495, 6f800d18-d86c-4d82-9bb8-ce480c8835aa => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:14:46 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] VM Resumed (Lifecycle Event)
Apr 12 09:14:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Instance spawned successfully.
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:14:46 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290886.1535788, 6f800d18-d86c-4d82-9bb8-ce480c8835aa => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:14:46 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] VM Started (Lifecycle Event)
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.objects.instance [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-99480487-0eb2-4d9b-885f-254c50501012 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.070s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:46 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:14:46 user nova-compute[71482]: INFO nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Took 14.85 seconds to spawn the instance on the hypervisor.
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:14:46 user nova-compute[71482]: INFO nova.compute.manager [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Took 30.80 seconds to build instance.
Apr 12 09:14:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-552725cf-c96e-4faa-be71-d2ae0e2fd4fa tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.897s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71482) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.objects.instance [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] <== connect_volume: return (1512ms) {'type': 'block', 'scsi_wwn': '26338343435306437', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338343435306437', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.objects.instance [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'flavor' on Instance uuid 3872dcd7-8f2e-4b6e-9450-f8939143a94d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:14:46 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:46 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:14:46 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:14:46 user nova-compute[71482]:   <serial>236d694a-0b00-4b38-8770-54a0485d8b56</serial>
Apr 12 09:14:46 user nova-compute[71482]: </disk>
Apr 12 09:14:46 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-unplugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-unplugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:47 user nova-compute[71482]: WARNING nova.compute.manager [req-62f6bdeb-833a-410c-8592-c593eaeafa40 req-52ad0a2d-cedc-477a-8a34-fb417e8a146c service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-unplugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state active and task_state powering-off.
Apr 12 09:14:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:14:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:14:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] No VIF found with MAC fa:16:3e:d0:b4:61, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:14:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94aa2c36-35ce-4f2c-b3b4-bb2aaac9188c tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.476s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:47 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance destroyed successfully.
Apr 12 09:14:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:14:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-cad13b5b-0bcf-4ee8-8a52-243bb03b517e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.917s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:48 user nova-compute[71482]: INFO nova.compute.manager [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Detaching volume 236d694a-0b00-4b38-8770-54a0485d8b56
Apr 12 09:14:48 user nova-compute[71482]: INFO nova.virt.block_device [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Attempting to driver detach volume 236d694a-0b00-4b38-8770-54a0485d8b56 from mountpoint /dev/vdb
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Attempting to detach device vdb from instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:14:48 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:48 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:14:48 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:14:48 user nova-compute[71482]:   <serial>236d694a-0b00-4b38-8770-54a0485d8b56</serial>
Apr 12 09:14:48 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:14:48 user nova-compute[71482]: </disk>
Apr 12 09:14:48 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:14:48 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Successfully detached device vdb from instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d from the persistent domain config.
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:14:48 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:14:48 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:14:48 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:14:48 user nova-compute[71482]:   <serial>236d694a-0b00-4b38-8770-54a0485d8b56</serial>
Apr 12 09:14:48 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:14:48 user nova-compute[71482]: </disk>
Apr 12 09:14:48 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updating instance_info_cache with network_info: [{"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:14:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681290889.0879984, 3872dcd7-8f2e-4b6e-9450-f8939143a94d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:14:49 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Successfully detached device vdb from instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d from the live domain config.
Apr 12 09:14:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TcvdoQUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:14:49 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ba550-8d89-40e2-ba65-e91df77008d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:14:49 user nova-compute[71482]: No targets found.
Apr 12 09:14:49 user nova-compute[71482]: iSNS:
Apr 12 09:14:49 user nova-compute[71482]: No targets found.
Apr 12 09:14:49 user nova-compute[71482]: STATIC:
Apr 12 09:14:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864
Apr 12 09:14:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e
Apr 12 09:14:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6
Apr 12 09:14:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344
Apr 12 09:14:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801
Apr 12 09:14:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83
Apr 12 09:14:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20
Apr 12 09:14:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56
Apr 12 09:14:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:14:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:14:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:14:49 user nova-compute[71482]: FIRMWARE:
Apr 12 09:14:49 user nova-compute[71482]: No targets found.
Apr 12 09:14:49 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:14:49 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:14:49 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74b1d9-d49e-4a75-aaea-a120c15460e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b4cfc0-2fdf-475f-8857-c2bd026a2295]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:14:49 user nova-compute[71482]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 (non-flash)
Apr 12 09:14:49 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c280670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee4c8a-9b90-47ea-851a-509e7cde387e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[009fb590-6037-481a-90b6-45b19cb220ef]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fffaf53-1460-4a0b-a1c7-9d1b7978861a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e973fc3-5bf8-4880-8b1e-5bdd5fad9d8b]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abf3a43-42fe-4398-8708-eca46a72fadd]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:14:49 user nova-compute[71482]: WARNING nova.compute.manager [req-d7ccec02-0c36-4dae-9706-21175d34e1d2 req-cc71ac83-8efa-41ad-8983-3b8e425104cc service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state stopped and task_state None.
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[acced6a9-fa08-432c-8a7d-4db3fd0b70df]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56, portal: 172.16.0.220,3260]
Apr 12 09:14:49 user nova-compute[71482]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56, portal: 172.16.0.220,3260] successful.
Apr 12 09:14:49 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d694a-0b00-4b38-8770-54a0485d8b56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e037a49d-cee9-4bbd-a40c-5dc894aec012]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] <== disconnect_volume: return (398ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:14:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:14:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:14:50 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'flavor' on Instance uuid 3872dcd7-8f2e-4b6e-9450-f8939143a94d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:14:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8fd26f1b-54d5-4de3-9438-397a94cf6fbb tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.879s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:14:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:14:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:14:55 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:14:55 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:14:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7564MB free_disk=26.29241943359375GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:14:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:14:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f683bc12-8fca-47de-b28e-a0070e77b387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 1d0bc5da-ed98-417a-9fc1-1f636887f035 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a5e42339-50fa-411c-94a1-c350727b7955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:14:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.790s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:14:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:14:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:02 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290887.557198, f683bc12-8fca-47de-b28e-a0070e77b387 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:15:02 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] VM Stopped (Lifecycle Event)
Apr 12 09:15:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3388350c-3a19-413f-98a9-b6fa7292a9bf None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:15:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3388350c-3a19-413f-98a9-b6fa7292a9bf None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:03 user nova-compute[71482]: INFO nova.compute.manager [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Terminating instance
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received event network-vif-unplugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] No waiting events found dispatching network-vif-unplugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-bd4c9975-d4df-47e4-a926-71f904b88f51 req-2057f0ce-33a2-49ee-ab3a-4391845a1e68 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received event network-vif-unplugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:03 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Instance destroyed successfully.
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.objects.instance [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lazy-loading 'resources' on Instance uuid 1d0bc5da-ed98-417a-9fc1-1f636887f035 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:09:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-918812097',display_name='tempest-VolumesAdminNegativeTest-server-918812097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-918812097',id=8,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuIgyZwMNd/jS/ptwUJ9c7NTZM1n41EYebpoe+m79K324B9wtg2doS6hIGg4lStBCzYi9hRmMjrSFhFxaPWDaPglTQ7D/AzXNQhJudprzbZalCEvYmeCtPngO6pepEMaQ==',key_name='tempest-keypair-521589223',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd9e7d6ece244a96b01277451a3ed5a5',ramdisk_id='',reservation_id='r-js06k03k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-588655718',owner_user_name='tempest-VolumesAdminNegativeTest-588655718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:09:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8911ec7c959541989cce3870ba11fb80',uuid=1d0bc5da-ed98-417a-9fc1-1f636887f035,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converting VIF {"id": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "address": "fa:16:3e:b0:30:3c", "network": {"id": "02dc198d-c79f-4def-869d-52fb8ff7dc23", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1388756341-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd9e7d6ece244a96b01277451a3ed5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473a9253-5e", "ovs_interfaceid": "473a9253-5ee7-4ef1-bd1a-f260bc80b158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:30:3c,bridge_name='br-int',has_traffic_filtering=True,id=473a9253-5ee7-4ef1-bd1a-f260bc80b158,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473a9253-5e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG os_vif [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:30:3c,bridge_name='br-int',has_traffic_filtering=True,id=473a9253-5ee7-4ef1-bd1a-f260bc80b158,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473a9253-5e') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap473a9253-5e, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:03 user nova-compute[71482]: INFO os_vif [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:30:3c,bridge_name='br-int',has_traffic_filtering=True,id=473a9253-5ee7-4ef1-bd1a-f260bc80b158,network=Network(02dc198d-c79f-4def-869d-52fb8ff7dc23),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473a9253-5e')
Apr 12 09:15:03 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Deleting instance files /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035_del
Apr 12 09:15:03 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Deletion of /opt/stack/data/nova/instances/1d0bc5da-ed98-417a-9fc1-1f636887f035_del complete
Apr 12 09:15:03 user nova-compute[71482]: INFO nova.compute.manager [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 12 09:15:03 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:15:03 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:15:04 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:15:04 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Took 0.68 seconds to deallocate network for instance.
Apr 12 09:15:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:05 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:15:05 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:15:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:05 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Deleted allocations for instance 1d0bc5da-ed98-417a-9fc1-1f636887f035
Apr 12 09:15:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-31930f94-7a49-45de-8163-c452e00d6ee1 tempest-VolumesAdminNegativeTest-588655718 tempest-VolumesAdminNegativeTest-588655718-project-member] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received event network-vif-plugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] Acquiring lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] Lock "1d0bc5da-ed98-417a-9fc1-1f636887f035-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] No waiting events found dispatching network-vif-plugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:05 user nova-compute[71482]: WARNING nova.compute.manager [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received unexpected event network-vif-plugged-473a9253-5ee7-4ef1-bd1a-f260bc80b158 for instance with vm_state deleted and task_state None.
Apr 12 09:15:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-c8f0d59b-4d12-455b-ac42-e7758529378a req-fbaa0911-ee37-4398-952d-8a3ba3221122 service nova] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Received event network-vif-deleted-473a9253-5ee7-4ef1-bd1a-f260bc80b158 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:18 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290903.8283138, 1d0bc5da-ed98-417a-9fc1-1f636887f035 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:15:18 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] VM Stopped (Lifecycle Event)
Apr 12 09:15:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-75d86c9e-6469-4749-bff9-16b392ae6854 None None] [instance: 1d0bc5da-ed98-417a-9fc1-1f636887f035] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:15:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:19 user nova-compute[71482]: INFO nova.compute.manager [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Unrescuing
Apr 12 09:15:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquired lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG nova.network.neutron [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG nova.network.neutron [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updating instance_info_cache with network_info: [{"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Releasing lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG nova.objects.instance [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'flavor' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG nova.compute.manager [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-unplugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG nova.compute.manager [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-unplugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:19 user nova-compute[71482]: WARNING nova.compute.manager [req-79fbb618-74ee-4327-8cf1-07737b87911f req-6b81b6ee-5ec3-4dd8-be6e-44c22cbff959 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-unplugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:15:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:20 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Instance destroyed successfully.
Apr 12 09:15:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:21 user nova-compute[71482]: WARNING nova.compute.manager [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:15:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:21 user nova-compute[71482]: WARNING nova.compute.manager [req-fb151b03-df0b-425f-b116-2007d89f808d req-50ca9ef2-572f-4866-ba63-620c29e1c5c8 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:15:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for e2070294-eb8a-4ee9-a4b5-baab508d8744 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:15:23 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290923.7082157, e2070294-eb8a-4ee9-a4b5-baab508d8744 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:15:23 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] VM Resumed (Lifecycle Event)
Apr 12 09:15:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-072305dd-f1c1-4c14-897f-e65bcc8b6577 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:15:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:15:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:15:23 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 09:15:23 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290923.7100303, e2070294-eb8a-4ee9-a4b5-baab508d8744 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:15:23 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] VM Started (Lifecycle Event)
Apr 12 09:15:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:15:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:15:23 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 09:15:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:24 user nova-compute[71482]: WARNING nova.compute.manager [req-a187451c-7f51-4825-98a3-a41f3345d981 req-2df2a999-abd8-4546-9140-bd0e68b124ee service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state active and task_state None.
Apr 12 09:15:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:15:34 user nova-compute[71482]: INFO nova.compute.manager [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Unrescuing
Apr 12 09:15:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:15:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquired lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:15:34 user nova-compute[71482]: DEBUG nova.network.neutron [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:15:34 user nova-compute[71482]: DEBUG nova.network.neutron [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updating instance_info_cache with network_info: [{"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:15:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Releasing lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:15:34 user nova-compute[71482]: DEBUG nova.objects.instance [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'flavor' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:15:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-unplugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-unplugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:35 user nova-compute[71482]: WARNING nova.compute.manager [req-859c90c9-4460-47db-8950-52df9e0441f0 req-578555f8-e89d-4f68-98e3-97cf4a87993c service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-unplugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:15:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:35 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance destroyed successfully.
Apr 12 09:15:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:37 user nova-compute[71482]: WARNING nova.compute.manager [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:15:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:37 user nova-compute[71482]: WARNING nova.compute.manager [req-f61f5487-9626-4010-a6b7-60274e7dd339 req-7bf335bf-5066-40ed-a55b-1ff75b3832ac service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:15:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 4a835849-83a7-457d-a96d-0acaa5a4a964 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290939.002868, 4a835849-83a7-457d-a96d-0acaa5a4a964 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:15:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] VM Resumed (Lifecycle Event)
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-51471759-7441-47eb-b877-46a83ecc02ef tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:15:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290939.0041354, 4a835849-83a7-457d-a96d-0acaa5a4a964 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:15:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] VM Started (Lifecycle Event)
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received event network-changed-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Refreshing instance network info cache due to event network-changed-cbba3d0e-337f-4f59-90b6-6216192cdb3b. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] Acquiring lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] Acquired lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.network.neutron [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Refreshing network info cache for port cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:39 user nova-compute[71482]: WARNING nova.compute.manager [req-1f3e8365-04ad-4022-ac5a-e7098d6f6fc7 req-099f43db-70e8-4e42-829f-f722c7f36c90 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state active and task_state None.
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:39 user nova-compute[71482]: INFO nova.compute.manager [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Terminating instance
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.network.neutron [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Updated VIF entry in instance network info cache for port cbba3d0e-337f-4f59-90b6-6216192cdb3b. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG nova.network.neutron [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Updating instance_info_cache with network_info: [{"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-784c972c-6f94-4c45-a353-f57933a17ce7 req-07a7dbcb-a1bb-4f93-a085-6a1d50cc449d service nova] Releasing lock "refresh_cache-3872dcd7-8f2e-4b6e-9450-f8939143a94d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:15:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Instance destroyed successfully.
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'resources' on Instance uuid 3872dcd7-8f2e-4b6e-9450-f8939143a94d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-957660484',display_name='tempest-TestStampPattern-server-957660484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-957660484',id=15,image_ref='f789b5a9-8687-4ad6-89b8-6ba9685a94d3',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+fsSS3XTWnvMjjcXo2M/eSLvS9TQwtC5Vw9sxk2wzTZ75i0he3Eo6b0vT0HPmDlWDm3m80IrirjqBjUz0Z8GQDLK2hw+EpHpQKcspVFgKhBnSTs/WZpB6phNQXZtwf0w==',key_name='tempest-TestStampPattern-1475014031',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:12:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81d39dd859ed4684a659c79ca3ea3fb4',ramdisk_id='',reservation_id='r-v8nhjbsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a5e42339-50fa-411c-94a1-c350727b7955',image_min_disk='1',image_min_ram='0',image_owner_id='81d39dd859ed4684a659c79ca3ea3fb4',image_owner_project_name='tempest-TestStampPattern-1126496829',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1126496829-project-member',image_user_id='e0440debc9af46e690788752e32f0912',owner_project_name='tempest-TestStampPattern-1126496829',owner_user_name='tempest-TestStampPattern-1126496829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:12:56Z,user_data=None,user_id='e0440debc9af46e690788752e32f0912',uuid=3872dcd7-8f2e-4b6e-9450-f8939143a94d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converting VIF {"id": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "address": "fa:16:3e:d0:b4:61", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbba3d0e-33", "ovs_interfaceid": "cbba3d0e-337f-4f59-90b6-6216192cdb3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b4:61,bridge_name='br-int',has_traffic_filtering=True,id=cbba3d0e-337f-4f59-90b6-6216192cdb3b,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbba3d0e-33') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG os_vif [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b4:61,bridge_name='br-int',has_traffic_filtering=True,id=cbba3d0e-337f-4f59-90b6-6216192cdb3b,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbba3d0e-33') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbba3d0e-33, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:40 user nova-compute[71482]: INFO os_vif [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b4:61,bridge_name='br-int',has_traffic_filtering=True,id=cbba3d0e-337f-4f59-90b6-6216192cdb3b,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbba3d0e-33')
Apr 12 09:15:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Deleting instance files /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d_del
Apr 12 09:15:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Deletion of /opt/stack/data/nova/instances/3872dcd7-8f2e-4b6e-9450-f8939143a94d_del complete
Apr 12 09:15:40 user nova-compute[71482]: INFO nova.compute.manager [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Took 0.93 seconds to destroy the instance on the hypervisor.
Apr 12 09:15:40 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:40 user nova-compute[71482]: INFO nova.compute.manager [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Detaching volume 95e901df-9a3a-4145-a12e-c77232853864
Apr 12 09:15:40 user nova-compute[71482]: INFO nova.virt.block_device [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attempting to driver detach volume 95e901df-9a3a-4145-a12e-c77232853864 from mountpoint /dev/vdb
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Attempting to detach device vdb from instance 4f211820-161b-4bef-b25d-ced137325da1 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:15:40 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:15:40 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:15:40 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:15:40 user nova-compute[71482]:   <serial>95e901df-9a3a-4145-a12e-c77232853864</serial>
Apr 12 09:15:40 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 09:15:40 user nova-compute[71482]: </disk>
Apr 12 09:15:40 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:15:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully detached device vdb from instance 4f211820-161b-4bef-b25d-ced137325da1 from the persistent domain config.
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f211820-161b-4bef-b25d-ced137325da1 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:15:40 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:15:40 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:15:40 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:15:40 user nova-compute[71482]:   <serial>95e901df-9a3a-4145-a12e-c77232853864</serial>
Apr 12 09:15:40 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 09:15:40 user nova-compute[71482]: </disk>
Apr 12 09:15:40 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:15:40 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Took 0.50 seconds to deallocate network for instance.
Apr 12 09:15:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681290941.1349306, 4f211820-161b-4bef-b25d-ced137325da1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:15:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully detached device vdb from instance 4f211820-161b-4bef-b25d-ced137325da1 from the live domain config.
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhczbRsE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:15:41 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbee4fb-4ae6-4e7d-9d76-67cdda9e8385]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:15:41 user nova-compute[71482]: No targets found.
Apr 12 09:15:41 user nova-compute[71482]: iSNS:
Apr 12 09:15:41 user nova-compute[71482]: No targets found.
Apr 12 09:15:41 user nova-compute[71482]: STATIC:
Apr 12 09:15:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864
Apr 12 09:15:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:15:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:15:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e
Apr 12 09:15:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:15:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:15:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6
Apr 12 09:15:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:15:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:15:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344
Apr 12 09:15:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:15:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:15:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801
Apr 12 09:15:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:15:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:15:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83
Apr 12 09:15:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:15:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:15:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20
Apr 12 09:15:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:15:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:15:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:15:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:15:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:15:41 user nova-compute[71482]: FIRMWARE:
Apr 12 09:15:41 user nova-compute[71482]: No targets found.
Apr 12 09:15:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:15:41 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:15:41 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c064bea-8d87-4a09-95bf-a79038d60b4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Deleted allocations for instance 3872dcd7-8f2e-4b6e-9450-f8939143a94d
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb07044-cd79-4e10-a064-70016c558982]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:15:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:15:41 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:15:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c203ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864'): ({'sdd'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Removing single pathed devices sdd {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5104e064-f464-4f89-8b85-81a9d5a52796]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-13f8bc87-981c-4aa4-a33a-db2fbd730a34 req-37dd1214-bedb-401f-abc3-a268c3287eb0 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received event network-vif-deleted-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e49f15-3108-413f-bc2d-55250c75d063]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flushing IO for device /dev/sdd {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f06443f-9b71-4d5f-8df7-2556d77f65d7]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received event network-vif-unplugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] No waiting events found dispatching network-vif-unplugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:41 user nova-compute[71482]: WARNING nova.compute.manager [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received unexpected event network-vif-unplugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance with vm_state deleted and task_state None.
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received event network-vif-plugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Acquiring lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] No waiting events found dispatching network-vif-plugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:41 user nova-compute[71482]: WARNING nova.compute.manager [req-3e837e6e-2a54-415b-b94f-c6140e55d4ce req-24acc052-6e02-468f-b02a-76c03c7de532 service nova] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Received unexpected event network-vif-plugged-cbba3d0e-337f-4f59-90b6-6216192cdb3b for instance with vm_state deleted and task_state None.
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e12e444c-13b3-4163-aef0-534948003a49 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "3872dcd7-8f2e-4b6e-9450-f8939143a94d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.980s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e919db-634d-4aba-b960-5310613f834d]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f40fa9-0a76-4235-b9f1-0d3e828ceba6]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0ad39e-5498-4b44-a106-98e4dfa1afb9]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260]
Apr 12 09:15:41 user nova-compute[71482]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864, portal: 172.16.0.220,3260] successful.
Apr 12 09:15:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:95e901df-9a3a-4145-a12e-c77232853864 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ec95d5-ff02-4783-bf54-11a61eb18629]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== disconnect_volume: return (377ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:15:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:15:42 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'flavor' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:15:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e25d1d98-46cc-472a-8d03-c719fbc0e877 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.886s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'flavor' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.270s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid a569c652-6b15-4244-b011-1d09fbdd4281 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid a5e42339-50fa-411c-94a1-c350727b7955 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid a4d42e71-e21f-465d-b0a1-7cc5dbe0494c {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid 6f800d18-d86c-4d82-9bb8-ce480c8835aa {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "a569c652-6b15-4244-b011-1d09fbdd4281" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a569c652-6b15-4244-b011-1d09fbdd4281" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a5e42339-50fa-411c-94a1-c350727b7955" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "4f211820-161b-4bef-b25d-ced137325da1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a569c652-6b15-4244-b011-1d09fbdd4281" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a5e42339-50fa-411c-94a1-c350727b7955" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "4f211820-161b-4bef-b25d-ced137325da1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:49 user nova-compute[71482]: INFO nova.compute.manager [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Attaching volume ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 to /dev/vdb
Apr 12 09:15:49 user nova-compute[71482]: DEBUG os_brick.utils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[664a12fe-4709-44f7-a578-b62374126283]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fa132a-6e4c-4b94-ab40-7b29e83d7fcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da5ec78-36d0-4919-8322-5ccb9c806fc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba2a043-0a21-4a61-92b4-ae4e3214a9fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:15:49 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:15:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd52172-6e55-4159-bdb1-c79ea8ab27c3]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG os_brick.utils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:15:49 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updating existing volume attachment record: 3bcc6564-8a94-4272-9d26-1b468bada177 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:15:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucgkSDoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:15:53 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:15:53 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:15:53 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[098e2405-7961-4c01-a746-cf04b86fb4e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:15:53 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[56458a7e-48ef-4ec8-bcb9-0fa51f980467]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927] added
Apr 12 09:15:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7545c480-b962-45e9-baab-7c8c9ee376f1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d56d911-3112-4347-b158-94f1cea1a69b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucgkSDoq {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucgkSDoq" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc19e2-a9b3-440c-a614-ccc9c20c7bd9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ucgkSDoq'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a608d9-ecc4-40f5-b22d-9cfb2dd3fd6d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[615291ab-d610-4397-b80b-48c24fb865ff]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:15:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:15:53 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:15:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --login" returned: 0 in 0.156s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3aa3ca-769c-4daf-a867-4dbe4d34c606]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927, portal: 172.16.0.220,3260]
Apr 12 09:15:53 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927, portal: 172.16.0.220,3260] successful.
Apr 12 09:15:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb8429d-8066-4697-9388-8372a13db9ab]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6da243-ea63-46e1-b55c-6dd0cc055aeb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:15:54 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:15:54 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.447s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a040be-7287-49d3-b976-b25c0763a2a2]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucgkSDoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:15:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:15:55 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:15:55 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7913MB free_disk=26.330303192138672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23062316437393062', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062316437393062', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'flavor' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:15:55 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:15:55 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:15:55 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:15:55 user nova-compute[71482]:   <serial>ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927</serial>
Apr 12 09:15:55 user nova-compute[71482]: </disk>
Apr 12 09:15:55 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290940.1749554, 3872dcd7-8f2e-4b6e-9450-f8939143a94d => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:15:55 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] VM Stopped (Lifecycle Event)
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-724e1256-533b-42c6-8dba-0b38f100485c None None] [instance: 3872dcd7-8f2e-4b6e-9450-f8939143a94d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f683bc12-8fca-47de-b28e-a0070e77b387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a5e42339-50fa-411c-94a1-c350727b7955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] No VIF found with MAC fa:16:3e:5d:48:ac, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:15:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f82f7a6c-8e51-45db-83e4-a5d8ae39642f tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.721s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:56 user nova-compute[71482]: INFO nova.compute.manager [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Rescuing
Apr 12 09:15:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:15:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquired lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:15:56 user nova-compute[71482]: DEBUG nova.network.neutron [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:15:57 user nova-compute[71482]: DEBUG nova.network.neutron [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updating instance_info_cache with network_info: [{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:15:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Releasing lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:15:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG nova.compute.manager [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-unplugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG nova.compute.manager [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-unplugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:15:58 user nova-compute[71482]: WARNING nova.compute.manager [req-82faf5d4-65bd-46d9-a4f6-3033b83274a5 req-9d5a6bbe-7538-42f9-ab64-ddd6a4baa57e service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-unplugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state active and task_state rescuing.
Apr 12 09:15:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:15:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Instance destroyed successfully.
Apr 12 09:15:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Attempting a stable device rescue
Apr 12 09:15:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Instance directory exists: not creating {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 09:15:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Creating image(s)
Apr 12 09:15:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG nova.objects.instance [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "054e20d370dda696fc4a3f4f0d8e57188a726d9f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:15:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "054e20d370dda696fc4a3f4f0d8e57188a726d9f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:15:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f.part --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:59 user nova-compute[71482]: DEBUG nova.virt.images [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] 86dc6d0f-1950-42bf-bc62-aaa37f02c115 was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:15:59 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:15:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f.part /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:15:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f.part /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f.converted" returned: 0 in 0.186s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:15:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f.converted --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "054e20d370dda696fc4a3f4f0d8e57188a726d9f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.435s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "054e20d370dda696fc4a3f4f0d8e57188a726d9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "054e20d370dda696fc4a3f4f0d8e57188a726d9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.compute.manager [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.compute.manager [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:00 user nova-compute[71482]: WARNING nova.compute.manager [req-a8088421-5a4c-47cb-84bb-5dd4ec4497d9 req-a4cabde9-3dfb-401e-89d9-cdede5b856d2 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state active and task_state rescuing.
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f,backing_fmt=raw /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.rescue {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f,backing_fmt=raw /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.rescue" returned: 0 in 0.048s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "054e20d370dda696fc4a3f4f0d8e57188a726d9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.183s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'migration_context' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Start _get_guest_xml network_info=[{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "vif_mac": "fa:16:3e:5d:48:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '86dc6d0f-1950-42bf-bc62-aaa37f02c115', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3bcc6564-8a94-4272-9d26-1b468bada177', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucgkSDoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '7cec0e09-36ac-43c7-9299-819b65c9da6b', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927', 'serial': 'ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'resources' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'numa_topology' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:00 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:16:00 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucgkSDoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:16:00 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:16:00 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:16:00 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a418c10-87f6-492c-b9b3-15156efcea24]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ucgkSDoq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 09:16:00 user nova-compute[71482]: node.name = iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:16:00 user nova-compute[71482]: node.tpgt = -1
Apr 12 09:16:00 user nova-compute[71482]: node.startup = automatic
Apr 12 09:16:00 user nova-compute[71482]: node.leading_login = No
Apr 12 09:16:00 user nova-compute[71482]: iface.iscsi_ifacename = default
Apr 12 09:16:00 user nova-compute[71482]: iface.net_ifacename = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.ipaddress = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.prefix_len = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.hwaddress = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.transport_name = tcp
Apr 12 09:16:00 user nova-compute[71482]: iface.initiatorname = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.state = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.vlan_id = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.vlan_priority = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.vlan_state = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.iface_num = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.mtu = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.port = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.bootproto = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.subnet_mask = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.gateway = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.dhcp_alt_client_id = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.dhcp_dns = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.dhcp_learn_iqn = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.dhcp_vendor_id_state = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.dhcp_vendor_id = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.dhcp_slp_da = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.fragmentation = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.gratuitous_arp = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.incoming_forwarding = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.tos_state = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.tos = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.ttl = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.delayed_ack = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.tcp_nagle = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.tcp_wsf_state = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.tcp_wsf = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.tcp_timer_scale = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.tcp_timestamp = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.redirect = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.def_task_mgmt_timeout = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.header_digest = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.data_digest = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.immediate_data = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.initial_r2t = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.data_seq_inorder = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.data_pdu_inorder = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.erl = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.max_receive_data_len = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.first_burst_len = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.max_outstanding_r2t = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.max_burst_len = 0
Apr 12 09:16:00 user nova-compute[71482]: iface.chap_auth = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.bidi_chap = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.strict_login_compliance = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.discovery_auth = <empty>
Apr 12 09:16:00 user nova-compute[71482]: iface.discovery_logout = <empty>
Apr 12 09:16:00 user nova-compute[71482]: node.discovery_address = <empty>
Apr 12 09:16:00 user nova-compute[71482]: node.discovery_port = 0
Apr 12 09:16:00 user nova-compute[71482]: node.discovery_type = static
Apr 12 09:16:00 user nova-compute[71482]: node.session.initial_cmdsn = 0
Apr 12 09:16:00 user nova-compute[71482]: node.session.initial_login_retry_max = 8
Apr 12 09:16:00 user nova-compute[71482]: node.session.xmit_thread_priority = -20
Apr 12 09:16:00 user nova-compute[71482]: node.session.cmds_max = 128
Apr 12 09:16:00 user nova-compute[71482]: node.session.queue_depth = 32
Apr 12 09:16:00 user nova-compute[71482]: node.session.nr_sessions = 1
Apr 12 09:16:00 user nova-compute[71482]: node.session.auth.authmethod = CHAP
Apr 12 09:16:00 user nova-compute[71482]: node.session.auth.username = ucgkSDoq
Apr 12 09:16:00 user nova-compute[71482]: node.session.auth.password = ***
Apr 12 09:16:00 user nova-compute[71482]: node.session.auth.username_in = <empty>
Apr 12 09:16:00 user nova-compute[71482]: node.session.auth.password_in = <empty>
Apr 12 09:16:00 user nova-compute[71482]: node.session.auth.chap_algs = MD5
Apr 12 09:16:00 user nova-compute[71482]: node.session.timeo.replacement_timeout = 120
Apr 12 09:16:00 user nova-compute[71482]: node.session.err_timeo.abort_timeout = 15
Apr 12 09:16:00 user nova-compute[71482]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 09:16:00 user nova-compute[71482]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 09:16:00 user nova-compute[71482]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.FastAbort = Yes
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.InitialR2T = No
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.ImmediateData = Yes
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.MaxConnections = 1
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 09:16:00 user nova-compute[71482]: node.session.iscsi.ERL = 0
Apr 12 09:16:00 user nova-compute[71482]: node.session.scan = manual
Apr 12 09:16:00 user nova-compute[71482]: node.session.reopen_max = 0
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].address = 172.16.0.220
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].port = 3260
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].startup = manual
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].tcp.window_size = 524288
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].tcp.type_of_service = 0
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].timeo.logout_timeout = 15
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].timeo.login_timeout = 15
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].timeo.auth_timeout = 45
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].iscsi.DataDigest = None
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].iscsi.IFMarker = No
Apr 12 09:16:00 user nova-compute[71482]: node.conn[0].iscsi.OFMarker = No
Apr 12 09:16:00 user nova-compute[71482]: # END RECORD
Apr 12 09:16:00 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea10fc0-3e08-44c3-9668-df425fdd44d4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c029b9c7-63f3-4aa2-a961-4b4beff63aba]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucgkSDoq {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ucgkSDoq" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[794fc317-9005-467c-b56f-f76fa5c03ec9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ucgkSDoq'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d25395-465e-4550-ab44-d68ce4f3c757]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[768193f5-f5dd-4277-b1bb-6f2d1edc3375]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:00 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:00 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.184s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] HCTL ('33', '0', '0', 0) found on session 22 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5fd6fd-c2e3-4777-b7a0-6575f08a4469]: (4, ('0 0 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Searching for a device in session 22 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucgkSDoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.207s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] <== connect_volume: return (209ms) {'type': 'block', 'scsi_wwn': '23062316437393062', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062316437393062', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-430343469',display_name='tempest-ServerStableDeviceRescueTest-server-430343469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-430343469',id=13,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4vJjgMKDKaWr0Dy8W2bVCeXaYOmTVfeTv9/3UEUmN+6itpsXzbaWpnFjPJUdjwFtuYYeFZdZPUeplH0aO/nZtpvGeDHXHuXoefAJJIu7CBy1InWrkCMQqKrIm1eU6g5A==',key_name='tempest-keypair-681767073',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:12:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28ede6e9cdbc4b71a1affaddfd1ad9a3',ramdisk_id='',reservation_id='r-7c212l7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1869366097',owner_user_name='tempest-ServerStableDeviceRescueTest-1869366097-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9afc908ad0e4ba9ab74006817cc0895',uuid=7cec0e09-36ac-43c7-9299-819b65c9da6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "vif_mac": "fa:16:3e:5d:48:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Converting VIF {"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "vif_mac": "fa:16:3e:5d:48:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:48:ac,bridge_name='br-int',has_traffic_filtering=True,id=dd53e034-3c1a-4153-b8ba-fc9db5cfea0e,network=Network(a113fe76-9546-4c8d-9c26-762c017f777f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd53e034-3c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:16:00 user nova-compute[71482]:   <uuid>7cec0e09-36ac-43c7-9299-819b65c9da6b</uuid>
Apr 12 09:16:00 user nova-compute[71482]:   <name>instance-0000000d</name>
Apr 12 09:16:00 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:16:00 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:16:00 user nova-compute[71482]:   <metadata>
Apr 12 09:16:00 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:16:00 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:16:00 user nova-compute[71482]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-430343469</nova:name>
Apr 12 09:16:00 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:16:00</nova:creationTime>
Apr 12 09:16:00 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:16:00 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:16:00 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:16:00 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:16:00 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:16:00 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:16:00 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:16:00 user nova-compute[71482]:       <nova:owner>
Apr 12 09:16:00 user nova-compute[71482]:         <nova:user uuid="d9afc908ad0e4ba9ab74006817cc0895">tempest-ServerStableDeviceRescueTest-1869366097-project-member</nova:user>
Apr 12 09:16:00 user nova-compute[71482]:         <nova:project uuid="28ede6e9cdbc4b71a1affaddfd1ad9a3">tempest-ServerStableDeviceRescueTest-1869366097</nova:project>
Apr 12 09:16:00 user nova-compute[71482]:       </nova:owner>
Apr 12 09:16:00 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:16:00 user nova-compute[71482]:       <nova:ports>
Apr 12 09:16:00 user nova-compute[71482]:         <nova:port uuid="dd53e034-3c1a-4153-b8ba-fc9db5cfea0e">
Apr 12 09:16:00 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 09:16:00 user nova-compute[71482]:         </nova:port>
Apr 12 09:16:00 user nova-compute[71482]:       </nova:ports>
Apr 12 09:16:00 user nova-compute[71482]:     </nova:instance>
Apr 12 09:16:00 user nova-compute[71482]:   </metadata>
Apr 12 09:16:00 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:16:00 user nova-compute[71482]:     <system>
Apr 12 09:16:00 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:16:00 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:16:00 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:16:00 user nova-compute[71482]:       <entry name="serial">7cec0e09-36ac-43c7-9299-819b65c9da6b</entry>
Apr 12 09:16:00 user nova-compute[71482]:       <entry name="uuid">7cec0e09-36ac-43c7-9299-819b65c9da6b</entry>
Apr 12 09:16:00 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:16:00 user nova-compute[71482]:     </system>
Apr 12 09:16:00 user nova-compute[71482]:   </sysinfo>
Apr 12 09:16:00 user nova-compute[71482]:   <os>
Apr 12 09:16:00 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:16:00 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:16:00 user nova-compute[71482]:   </os>
Apr 12 09:16:00 user nova-compute[71482]:   <features>
Apr 12 09:16:00 user nova-compute[71482]:     <acpi/>
Apr 12 09:16:00 user nova-compute[71482]:     <apic/>
Apr 12 09:16:00 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:16:00 user nova-compute[71482]:   </features>
Apr 12 09:16:00 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:16:00 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:16:00 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:16:00 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:16:00 user nova-compute[71482]:   </clock>
Apr 12 09:16:00 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:16:00 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:16:00 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:16:00 user nova-compute[71482]:   </cpu>
Apr 12 09:16:00 user nova-compute[71482]:   <devices>
Apr 12 09:16:00 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:16:00 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:16:00 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk"/>
Apr 12 09:16:00 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:16:00 user nova-compute[71482]:     </disk>
Apr 12 09:16:00 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:16:00 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:16:00 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:16:00 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:16:00 user nova-compute[71482]:       <serial>ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927</serial>
Apr 12 09:16:00 user nova-compute[71482]:     </disk>
Apr 12 09:16:00 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:16:00 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:16:00 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.rescue"/>
Apr 12 09:16:00 user nova-compute[71482]:       <target dev="vdc" bus="virtio"/>
Apr 12 09:16:00 user nova-compute[71482]:       <boot order="1"/>
Apr 12 09:16:00 user nova-compute[71482]:     </disk>
Apr 12 09:16:00 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:16:00 user nova-compute[71482]:       <mac address="fa:16:3e:5d:48:ac"/>
Apr 12 09:16:00 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:16:00 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:16:00 user nova-compute[71482]:       <target dev="tapdd53e034-3c"/>
Apr 12 09:16:00 user nova-compute[71482]:     </interface>
Apr 12 09:16:00 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:16:00 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/console.log" append="off"/>
Apr 12 09:16:00 user nova-compute[71482]:     </serial>
Apr 12 09:16:00 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:16:00 user nova-compute[71482]:     <video>
Apr 12 09:16:00 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:16:00 user nova-compute[71482]:     </video>
Apr 12 09:16:00 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:16:00 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:16:00 user nova-compute[71482]:     </rng>
Apr 12 09:16:00 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:16:00 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:16:00 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:16:00 user nova-compute[71482]:     </memballoon>
Apr 12 09:16:00 user nova-compute[71482]:   </devices>
Apr 12 09:16:00 user nova-compute[71482]: </domain>
Apr 12 09:16:00 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:16:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Instance destroyed successfully.
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] No VIF found with MAC fa:16:3e:5d:48:ac, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:16:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-changed-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing instance network info cache due to event network-changed-8403a9c1-5cfb-4f4a-bace-89f6a6130872. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:16:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] Acquiring lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:16:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] Acquired lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:16:01 user nova-compute[71482]: DEBUG nova.network.neutron [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Refreshing network info cache for port 8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG nova.network.neutron [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updated VIF entry in instance network info cache for port 8403a9c1-5cfb-4f4a-bace-89f6a6130872. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG nova.network.neutron [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [{"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7f3dd179-089e-4e57-9ccb-e0cc2ecf6073 req-207af1ce-3ad6-422d-882f-2a77f8e4ea1e service nova] Releasing lock "refresh_cache-a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:02 user nova-compute[71482]: WARNING nova.compute.manager [req-72656701-5d52-4474-98d2-ce3b03650bf8 req-31a38180-235d-42a5-bad7-1508ce35d3f3 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state active and task_state rescuing.
Apr 12 09:16:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:03 user nova-compute[71482]: INFO nova.compute.manager [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Terminating instance
Apr 12 09:16:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-unplugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-307c0664-e169-4c47-bbf3-a1f8a43eb664 req-da20e8e9-2722-46ad-9d5c-b453b0405f2e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-unplugged-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba9aa202-eec6-49ce-b3f9-10087e65685e req-113bac4b-3153-4099-9988-9005fc25d921 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-422290f4-824f-41ca-9a75-8031d21416a5 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:04 user nova-compute[71482]: WARNING nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state active and task_state rescuing.
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-unplugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:04 user nova-compute[71482]: WARNING nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-8403a9c1-5cfb-4f4a-bace-89f6a6130872 for instance with vm_state active and task_state deleting.
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-unplugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:04 user nova-compute[71482]: WARNING nova.compute.manager [req-7cf7ddcd-374b-4681-bdd8-88516a3d2c70 req-d944961f-8081-41a4-8a20-e690c7838e90 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-13cd3fb5-aca8-4a53-ba4e-3e810c35e853 for instance with vm_state active and task_state deleting.
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 7cec0e09-36ac-43c7-9299-819b65c9da6b due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290964.5678203, 7cec0e09-36ac-43c7-9299-819b65c9da6b => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:16:04 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] VM Resumed (Lifecycle Event)
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-842fe044-4306-4ada-a74d-dd908545b0cb tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:16:04 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681290964.5680377, 7cec0e09-36ac-43c7-9299-819b65c9da6b => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:16:04 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] VM Started (Lifecycle Event)
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:16:04 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Instance destroyed successfully.
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.objects.instance [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lazy-loading 'resources' on Instance uuid a4d42e71-e21f-465d-b0a1-7cc5dbe0494c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:d6:73,bridge_name='br-int',has_traffic_filtering=True,id=8403a9c1-5cfb-4f4a-bace-89f6a6130872,network=Network(49518285-f6aa-449f-ab1b-f86fb262a325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8403a9c1-5c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:d6:73,bridge_name='br-int',has_traffic_filtering=True,id=8403a9c1-5cfb-4f4a-bace-89f6a6130872,network=Network(49518285-f6aa-449f-ab1b-f86fb262a325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8403a9c1-5c') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8403a9c1-5c, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: INFO os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:d6:73,bridge_name='br-int',has_traffic_filtering=True,id=8403a9c1-5cfb-4f4a-bace-89f6a6130872,network=Network(49518285-f6aa-449f-ab1b-f86fb262a325),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8403a9c1-5c')
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:b3:ba,bridge_name='br-int',has_traffic_filtering=True,id=1de643f2-6b45-4ca5-92ca-057a72e44f63,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1de643f2-6b') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b3:ba,bridge_name='br-int',has_traffic_filtering=True,id=1de643f2-6b45-4ca5-92ca-057a72e44f63,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1de643f2-6b') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1de643f2-6b, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: INFO os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:b3:ba,bridge_name='br-int',has_traffic_filtering=True,id=1de643f2-6b45-4ca5-92ca-057a72e44f63,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1de643f2-6b')
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:47:b1,bridge_name='br-int',has_traffic_filtering=True,id=13cd3fb5-aca8-4a53-ba4e-3e810c35e853,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cd3fb5-ac') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:47:b1,bridge_name='br-int',has_traffic_filtering=True,id=13cd3fb5-aca8-4a53-ba4e-3e810c35e853,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cd3fb5-ac') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13cd3fb5-ac, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: INFO os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:47:b1,bridge_name='br-int',has_traffic_filtering=True,id=13cd3fb5-aca8-4a53-ba4e-3e810c35e853,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap13cd3fb5-ac')
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=d221807b-9715-4917-99a5-eecefd100946,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd221807b-97') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=d221807b-9715-4917-99a5-eecefd100946,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd221807b-97') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd221807b-97, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: INFO os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:2c:f8,bridge_name='br-int',has_traffic_filtering=True,id=d221807b-9715-4917-99a5-eecefd100946,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd221807b-97')
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:5f:09,bridge_name='br-int',has_traffic_filtering=True,id=422290f4-824f-41ca-9a75-8031d21416a5,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422290f4-82') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5f:09,bridge_name='br-int',has_traffic_filtering=True,id=422290f4-824f-41ca-9a75-8031d21416a5,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422290f4-82') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap422290f4-82, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: INFO os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:5f:09,bridge_name='br-int',has_traffic_filtering=True,id=422290f4-824f-41ca-9a75-8031d21416a5,network=Network(ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422290f4-82')
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "address": "fa:16:3e:ae:c5:d9", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69ed460b-cb", "ovs_interfaceid": "69ed460b-cbfb-4ab2-9008-58b16a554e4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c5:d9,bridge_name='br-int',has_traffic_filtering=True,id=69ed460b-cbfb-4ab2-9008-58b16a554e4a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ed460b-cb') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c5:d9,bridge_name='br-int',has_traffic_filtering=True,id=69ed460b-cbfb-4ab2-9008-58b16a554e4a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ed460b-cb') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69ed460b-cb, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: INFO os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:c5:d9,bridge_name='br-int',has_traffic_filtering=True,id=69ed460b-cbfb-4ab2-9008-58b16a554e4a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69ed460b-cb')
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-957238113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-957238113',id=16,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPn2DE5Za1oaMMJUrM4LCqPDQ56ATv27CcNUcE8j/RloSSrZrUNajqameR/Gs35k1dFlSh9SBeM8tPdaZ0CwNo6JM165psemKRBOjuhdFH7JurZtcrNH7uOXYsmjhz8Weg==',key_name='tempest-keypair-997992342',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa7c759e2e974720a71b31ddbb2adba8',ramdisk_id='',reservation_id='r-gh471b20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-683378533',owner_user_name='tempest-TaggedBootDevicesTest_v242-683378533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614726429a894b9499267c0c533330b8',uuid=a4d42e71-e21f-465d-b0a1-7cc5dbe0494c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converting VIF {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:45:70,bridge_name='br-int',has_traffic_filtering=True,id=80680073-3437-4be0-bf87-9ab62eb1320a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80680073-34') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:45:70,bridge_name='br-int',has_traffic_filtering=True,id=80680073-3437-4be0-bf87-9ab62eb1320a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80680073-34') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80680073-34, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:05 user nova-compute[71482]: INFO os_vif [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:45:70,bridge_name='br-int',has_traffic_filtering=True,id=80680073-3437-4be0-bf87-9ab62eb1320a,network=Network(c98aea99-4504-4ee1-8c0f-1a43ac486ae2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80680073-34')
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tiScTGXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:16:05 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdd6dd8-237a-4846-9933-309d80600427]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:16:05 user nova-compute[71482]: No targets found.
Apr 12 09:16:05 user nova-compute[71482]: iSNS:
Apr 12 09:16:05 user nova-compute[71482]: No targets found.
Apr 12 09:16:05 user nova-compute[71482]: STATIC:
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: FIRMWARE:
Apr 12 09:16:05 user nova-compute[71482]: No targets found.
Apr 12 09:16:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:16:05 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:16:05 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3966d83d-33fa-4e0c-9ece-336e234c68ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb3d818-c041-4b8f-850e-0326fd670c98]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f93441b0e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801'): ({'sde'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Removing single pathed devices sde {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35880ce8-04ad-494c-9adf-d1190c62fefd]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e22d2f6-895f-4255-902a-534641470c5b]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Flushing IO for device /dev/sde {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06aaa8d-fbb6-47c8-b59e-6c20ad24e0c2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbbde49-f777-4e37-bdac-fef835bc70e4]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] SCSI volumes sde have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[575c9001-7dce-4803-927c-cb27964c4492]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dfea5a-e0a6-429b-9318-29098ec0daed]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801, portal: 172.16.0.220,3260]
Apr 12 09:16:05 user nova-compute[71482]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801, portal: 172.16.0.220,3260] successful.
Apr 12 09:16:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:05 user nova-compute[71482]: WARNING nova.compute.manager [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-1de643f2-6b45-4ca5-92ca-057a72e44f63 for instance with vm_state active and task_state deleting.
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-unplugged-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-d221807b-9715-4917-99a5-eecefd100946 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:05 user nova-compute[71482]: WARNING nova.compute.manager [req-6ba26561-4714-4aea-979e-4313d582dbe1 req-245b1166-a2b7-41ec-9ec8-da31bb0c222d service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-d221807b-9715-4917-99a5-eecefd100946 for instance with vm_state active and task_state deleting.
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ba76717-8078-4e70-8674-985933f03801 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed01e90-bf4a-4080-a7eb-b767d712e87d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] <== disconnect_volume: return (402ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UzOaMpdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:16:05 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a790ae7-eb34-4315-8e0c-c579b6ed5b21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:16:05 user nova-compute[71482]: No targets found.
Apr 12 09:16:05 user nova-compute[71482]: iSNS:
Apr 12 09:16:05 user nova-compute[71482]: No targets found.
Apr 12 09:16:05 user nova-compute[71482]: STATIC:
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:16:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:05 user nova-compute[71482]: FIRMWARE:
Apr 12 09:16:05 user nova-compute[71482]: No targets found.
Apr 12 09:16:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:16:05 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:16:05 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca83a2bf-a272-402e-8393-66743880ab58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6773d982-eff3-4661-96b1-7ec8b76c3e8b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:05 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c25cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6'): ({'sdf'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Removing single pathed devices sdf {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2184ac-129d-4b1d-864e-a447eb0d68c6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef58f04-7ecc-4d39-8d62-29ceb1102438]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Flushing IO for device /dev/sdf {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[30715b46-0884-4b36-9820-b5f59632cf66]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a743e2-1468-4cc3-9e26-81812015c398]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] SCSI volumes sdf have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ba4198-f2ce-4982-b16d-13b5f8a03445]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a942b4-55d4-4146-aac2-ab220a11638d]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6, portal: 172.16.0.220,3260]
Apr 12 09:16:05 user nova-compute[71482]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6, portal: 172.16.0.220,3260] successful.
Apr 12 09:16:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebae2e1-26c4-4850-b330-67cd69d5afb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaa11a4-9625-456c-8d15-87af05bbbc0e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] <== disconnect_volume: return (375ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qidDRhjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:16:05 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:16:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:06 user nova-compute[71482]: WARNING nova.compute.manager [req-ad00c238-9c61-4377-a1d6-de3f1a82716c req-f1e30836-7364-4b8a-8d38-9bd99b486c3e service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-422290f4-824f-41ca-9a75-8031d21416a5 for instance with vm_state active and task_state deleting.
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[df29a606-6735-4da5-b838-202be5a9cfd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:16:06 user nova-compute[71482]: No targets found.
Apr 12 09:16:06 user nova-compute[71482]: iSNS:
Apr 12 09:16:06 user nova-compute[71482]: No targets found.
Apr 12 09:16:06 user nova-compute[71482]: STATIC:
Apr 12 09:16:06 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:16:06 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:06 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:06 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e
Apr 12 09:16:06 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:06 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:06 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344
Apr 12 09:16:06 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:06 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:06 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83
Apr 12 09:16:06 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:06 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:06 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20
Apr 12 09:16:06 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:06 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:06 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:16:06 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:06 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:06 user nova-compute[71482]: FIRMWARE:
Apr 12 09:16:06 user nova-compute[71482]: No targets found.
Apr 12 09:16:06 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:16:06 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:16:06 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33c4872-e952-4a78-ad0c-7c5022896f92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[500bd892-8a06-4b06-bef0-70f354498292]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:06 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:06 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:06 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f934436fb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20'): ({'sdg'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Removing single pathed devices sdg {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6497d1-6050-4a9b-8fbc-998885d690ed]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c46d099-5af5-4f34-a64c-025286d3e80c]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Flushing IO for device /dev/sdg {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0f2a1e-2a9c-4070-b09b-48895a2a4746]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e48afc0-02bd-4611-93f7-c851f988f697]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] SCSI volumes sdg have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eef7f6-aa2a-41c8-a05b-fc6f00d94fd9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c464b01-8265-4bff-a964-2ca5342ed9ea]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20, portal: 172.16.0.220,3260]
Apr 12 09:16:06 user nova-compute[71482]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20, portal: 172.16.0.220,3260] successful.
Apr 12 09:16:06 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce66f1cf-2d13-4309-b3d7-3a48dcd60b20 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[602a3723-3177-426c-a071-aa1ab52f2a98]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.440s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] <== disconnect_volume: return (442ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:16:06 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Deleting instance files /opt/stack/data/nova/instances/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c_del
Apr 12 09:16:06 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Deletion of /opt/stack/data/nova/instances/a4d42e71-e21f-465d-b0a1-7cc5dbe0494c_del complete
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-unplugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:06 user nova-compute[71482]: WARNING nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-69ed460b-cbfb-4ab2-9008-58b16a554e4a for instance with vm_state active and task_state deleting.
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-unplugged-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-unplugged-80680073-3437-4be0-bf87-9ab62eb1320a for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-plugged-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Acquiring lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] No waiting events found dispatching network-vif-plugged-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:06 user nova-compute[71482]: WARNING nova.compute.manager [req-b1cc171a-89f4-4727-b701-b9a69533075a req-e0833215-e834-477d-9029-de324d9bb41f service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received unexpected event network-vif-plugged-80680073-3437-4be0-bf87-9ab62eb1320a for instance with vm_state active and task_state deleting.
Apr 12 09:16:06 user nova-compute[71482]: INFO nova.compute.manager [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Took 3.49 seconds to destroy the instance on the hypervisor.
Apr 12 09:16:06 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:16:06 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:16:07 user nova-compute[71482]: DEBUG nova.compute.manager [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-changed-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:07 user nova-compute[71482]: DEBUG nova.compute.manager [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing instance network info cache due to event network-changed-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:16:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] Acquiring lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:16:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] Acquired lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:16:07 user nova-compute[71482]: DEBUG nova.network.neutron [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Refreshing network info cache for port 01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:08 user nova-compute[71482]: INFO nova.compute.manager [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Terminating instance
Apr 12 09:16:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-unplugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-9da74fa2-93aa-4f0a-86de-cd274eb1c10a req-4e08cb5b-2bdf-46f7-8741-7e2ec3f538e5 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG nova.network.neutron [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updated VIF entry in instance network info cache for port 01bd698c-51c6-4aa0-963c-6e12f8b2a5ff. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG nova.network.neutron [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e95e73fe-5e7d-4147-a0e7-0e24ec9525df req-cb94b9a4-bf5b-4ddb-9839-1c9d3cce1748 service nova] Releasing lock "refresh_cache-6f800d18-d86c-4d82-9bb8-ce480c8835aa" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-unplugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-38955c9d-4804-49ab-9243-7d0aa199b193 req-06e27e51-7035-4ad9-a974-cbb903ea44b1 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-unplugged-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-0a6649c3-bb81-4507-8666-3d78390b0579 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:09 user nova-compute[71482]: WARNING nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-0a6649c3-bb81-4507-8666-3d78390b0579 for instance with vm_state active and task_state deleting.
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-unplugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:09 user nova-compute[71482]: WARNING nova.compute.manager [req-8a1d031e-a4e8-48ea-bf18-bbf353b137d6 req-32f2dc01-13eb-423c-8e82-fa8b4bec6a49 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd for instance with vm_state active and task_state deleting.
Apr 12 09:16:09 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Instance destroyed successfully.
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.objects.instance [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lazy-loading 'resources' on Instance uuid 6f800d18-d86c-4d82-9bb8-ce480c8835aa {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:09:79,bridge_name='br-int',has_traffic_filtering=True,id=01bd698c-51c6-4aa0-963c-6e12f8b2a5ff,network=Network(b85c5e98-acc1-431c-896a-2f20a3e0387b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bd698c-51') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:09:79,bridge_name='br-int',has_traffic_filtering=True,id=01bd698c-51c6-4aa0-963c-6e12f8b2a5ff,network=Network(b85c5e98-acc1-431c-896a-2f20a3e0387b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bd698c-51') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01bd698c-51, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: INFO os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:09:79,bridge_name='br-int',has_traffic_filtering=True,id=01bd698c-51c6-4aa0-963c-6e12f8b2a5ff,network=Network(b85c5e98-acc1-431c-896a-2f20a3e0387b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01bd698c-51')
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e85632b-0047-4c19-8d7a-745e21a1bb97,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8e85632b-00') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e85632b-0047-4c19-8d7a-745e21a1bb97,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8e85632b-00') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e85632b-00, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: INFO os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:d3:78,bridge_name='br-int',has_traffic_filtering=True,id=8e85632b-0047-4c19-8d7a-745e21a1bb97,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8e85632b-00')
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4e:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f3437a2-863d-44c4-8d16-29e58aadf676,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f3437a2-86') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4e:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f3437a2-863d-44c4-8d16-29e58aadf676,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f3437a2-86') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f3437a2-86, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: INFO os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:4e:8e,bridge_name='br-int',has_traffic_filtering=True,id=9f3437a2-863d-44c4-8d16-29e58aadf676,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9f3437a2-86')
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=0a6649c3-bb81-4507-8666-3d78390b0579,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6649c3-bb') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=0a6649c3-bb81-4507-8666-3d78390b0579,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6649c3-bb') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a6649c3-bb, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: INFO os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:af:3c,bridge_name='br-int',has_traffic_filtering=True,id=0a6649c3-bb81-4507-8666-3d78390b0579,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6649c3-bb')
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0f:a1,bridge_name='br-int',has_traffic_filtering=True,id=ebada7ae-e22b-4447-b0c2-ceccd02aa6bd,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebada7ae-e2') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0f:a1,bridge_name='br-int',has_traffic_filtering=True,id=ebada7ae-e22b-4447-b0c2-ceccd02aa6bd,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebada7ae-e2') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebada7ae-e2, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: INFO os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0f:a1,bridge_name='br-int',has_traffic_filtering=True,id=ebada7ae-e22b-4447-b0c2-ceccd02aa6bd,network=Network(f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebada7ae-e2')
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=f4d0c163-2589-499a-8da8-68891a344baf,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d0c163-25') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=f4d0c163-2589-499a-8da8-68891a344baf,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d0c163-25') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4d0c163-25, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: INFO os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:2a:53,bridge_name='br-int',has_traffic_filtering=True,id=f4d0c163-2589-499a-8da8-68891a344baf,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4d0c163-25')
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-12T09:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-721191578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-721191578',id=17,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6eNt0TK7SxX1Dq5CY6r+DzMH4lx5MKslJe4lIK/cTRkSJIRWIoday4yuu4rYrXgL1kPvEVow4ewmSqZBp2+TRp/fujdKt2rO/HM1LDIulIxCTU8QOZRACY4zFGtN2S/Q==',key_name='tempest-keypair-302183567',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:14:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ce13a09e5b842b1997cee5123e0f167',ramdisk_id='',reservation_id='r-8ruethol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1718738212',owner_user_name='tempest-TaggedBootDevicesTest-1718738212-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='40052fbebbb4401f89f591ca889b0cfa',uuid=6f800d18-d86c-4d82-9bb8-ce480c8835aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converting VIF {"id": "be9408ea-445a-400a-a479-2c948b0e2a90", "address": "fa:16:3e:e1:6f:75", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe9408ea-44", "ovs_interfaceid": "be9408ea-445a-400a-a479-2c948b0e2a90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:75,bridge_name='br-int',has_traffic_filtering=True,id=be9408ea-445a-400a-a479-2c948b0e2a90,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9408ea-44') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:75,bridge_name='br-int',has_traffic_filtering=True,id=be9408ea-445a-400a-a479-2c948b0e2a90,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9408ea-44') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe9408ea-44, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:10 user nova-compute[71482]: INFO os_vif [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:6f:75,bridge_name='br-int',has_traffic_filtering=True,id=be9408ea-445a-400a-a479-2c948b0e2a90,network=Network(772dd9a8-a15b-466c-b344-9bc31830f878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe9408ea-44')
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HehbcwkP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:16:10 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9e0d97-ecec-4c8e-8b46-ff2c11f209e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:16:10 user nova-compute[71482]: No targets found.
Apr 12 09:16:10 user nova-compute[71482]: iSNS:
Apr 12 09:16:10 user nova-compute[71482]: No targets found.
Apr 12 09:16:10 user nova-compute[71482]: STATIC:
Apr 12 09:16:10 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:16:10 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:10 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:10 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e
Apr 12 09:16:10 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:10 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:10 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344
Apr 12 09:16:10 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:10 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:10 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83
Apr 12 09:16:10 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:10 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:10 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:16:10 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:10 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:10 user nova-compute[71482]: FIRMWARE:
Apr 12 09:16:10 user nova-compute[71482]: No targets found.
Apr 12 09:16:10 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:16:10 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:16:10 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb9a37-0fba-4ed4-9954-7812b1852c49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[67214ecb-3339-454e-9d21-051c68634be4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c10fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344'): ({'sdh'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Removing single pathed devices sdh {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4ecbcd-ec6b-476c-8cfe-f500463bc52a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4f7558-7b87-44f5-a9ac-60a61077cc0f]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Flushing IO for device /dev/sdh {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c396aba-d750-4018-be66-0e59395c04b3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7cf658-8218-4d00-bbe6-afabc7a7bf40]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] SCSI volumes sdh have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f294ab70-5743-4590-9544-2501217738b6]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9cfeff-8c15-4d40-bae6-d2417e8e9089]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344, portal: 172.16.0.220,3260]
Apr 12 09:16:10 user nova-compute[71482]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344, portal: 172.16.0.220,3260] successful.
Apr 12 09:16:10 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d7ff3a5-498a-4f2d-95b7-2a0e77950344 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf84d0a-9933-4efd-ae67-1b1eda21e527]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] <== disconnect_volume: return (343ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bGZylXUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:16:10 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5946df6b-d8e7-4177-8810-9225f013f5f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:16:10 user nova-compute[71482]: No targets found.
Apr 12 09:16:10 user nova-compute[71482]: iSNS:
Apr 12 09:16:10 user nova-compute[71482]: No targets found.
Apr 12 09:16:10 user nova-compute[71482]: STATIC:
Apr 12 09:16:10 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:16:10 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:10 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:10 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e
Apr 12 09:16:10 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:10 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:10 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83
Apr 12 09:16:10 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:10 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:10 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:16:10 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:10 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:10 user nova-compute[71482]: FIRMWARE:
Apr 12 09:16:10 user nova-compute[71482]: No targets found.
Apr 12 09:16:10 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:16:10 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:16:10 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:10 user nova-compute[71482]: WARNING nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-8e85632b-0047-4c19-8d7a-745e21a1bb97 for instance with vm_state active and task_state deleting.
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-unplugged-9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-9f3437a2-863d-44c4-8d16-29e58aadf676 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-9f3437a2-863d-44c4-8d16-29e58aadf676 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:10 user nova-compute[71482]: WARNING nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-9f3437a2-863d-44c4-8d16-29e58aadf676 for instance with vm_state active and task_state deleting.
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-unplugged-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-f4d0c163-2589-499a-8da8-68891a344baf for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:10 user nova-compute[71482]: WARNING nova.compute.manager [req-b0589091-403c-44ae-b0ae-029ba2417b58 req-c6a8b52d-10ab-41ea-bb4d-a0326a37f146 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-f4d0c163-2589-499a-8da8-68891a344baf for instance with vm_state active and task_state deleting.
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[53755957-f47b-4c39-8dd0-0eec63f254f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8052cf-7dd5-404e-a5ff-389dd67ee66a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:10 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:10 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c2f5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83'): ({'sdi'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Removing single pathed devices sdi {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d750413d-9824-4994-93ad-49fa4b291f09]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79353cc-e7df-44af-b390-c6d5e18d8b91]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Flushing IO for device /dev/sdi {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[539ec9c5-7f98-4d74-8dd2-311f66576334]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:16:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac83ed-872a-4b50-a977-7b9c2e374ceb]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] SCSI volumes sdi have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f38b0a-9bd4-4036-ba0b-455ea6d459f0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa542c73-92d0-4f50-84a1-dfff043e7cbe]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83, portal: 172.16.0.220,3260]
Apr 12 09:16:11 user nova-compute[71482]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83, portal: 172.16.0.220,3260] successful.
Apr 12 09:16:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:91bd6c2d-ef3f-491f-904a-32510538ec83 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da61fcd-a75a-478e-9578-7c2320416f43]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] <== disconnect_volume: return (327ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JWURkLYi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:16:11 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebb6f6d-81b5-4918-8bc1-07ab56ce6ae9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:16:11 user nova-compute[71482]: No targets found.
Apr 12 09:16:11 user nova-compute[71482]: iSNS:
Apr 12 09:16:11 user nova-compute[71482]: No targets found.
Apr 12 09:16:11 user nova-compute[71482]: STATIC:
Apr 12 09:16:11 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:16:11 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:11 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:11 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e
Apr 12 09:16:11 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:11 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:11 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:16:11 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:16:11 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:16:11 user nova-compute[71482]: FIRMWARE:
Apr 12 09:16:11 user nova-compute[71482]: No targets found.
Apr 12 09:16:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:16:11 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:16:11 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:11 user nova-compute[71482]: WARNING nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff for instance with vm_state active and task_state deleting.
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-deleted-69ed460b-cbfb-4ab2-9008-58b16a554e4a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:11 user nova-compute[71482]: INFO nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Neutron deleted interface 69ed460b-cbfb-4ab2-9008-58b16a554e4a; detaching it from the instance and deleting it from the info cache
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.network.neutron [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [{"id": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "address": "fa:16:3e:1b:d6:73", "network": {"id": "49518285-f6aa-449f-ab1b-f86fb262a325", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1497077345-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8403a9c1-5c", "ovs_interfaceid": "8403a9c1-5cfb-4f4a-bace-89f6a6130872", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0a8ad1-2b4c-4035-b976-88a9df6a56ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Detach interface failed, port_id=69ed460b-cbfb-4ab2-9008-58b16a554e4a, reason: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-unplugged-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-unplugged-be9408ea-445a-400a-a479-2c948b0e2a90 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-plugged-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Acquiring lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] No waiting events found dispatching network-vif-plugged-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:11 user nova-compute[71482]: WARNING nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received unexpected event network-vif-plugged-be9408ea-445a-400a-a479-2c948b0e2a90 for instance with vm_state active and task_state deleting.
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-deleted-8403a9c1-5cfb-4f4a-bace-89f6a6130872 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:11 user nova-compute[71482]: INFO nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Neutron deleted interface 8403a9c1-5cfb-4f4a-bace-89f6a6130872; detaching it from the instance and deleting it from the info cache
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.network.neutron [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [{"id": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "address": "fa:16:3e:11:b3:ba", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.243", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1de643f2-6b", "ovs_interfaceid": "1de643f2-6b45-4ca5-92ca-057a72e44f63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "address": "fa:16:3e:5d:47:b1", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.77", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13cd3fb5-ac", "ovs_interfaceid": "13cd3fb5-aca8-4a53-ba4e-3e810c35e853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d221807b-9715-4917-99a5-eecefd100946", "address": "fa:16:3e:0a:2c:f8", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.190", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd221807b-97", "ovs_interfaceid": "d221807b-9715-4917-99a5-eecefd100946", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "422290f4-824f-41ca-9a75-8031d21416a5", "address": "fa:16:3e:87:5f:09", "network": {"id": "ca5e26b6-b95b-4b8e-92fe-fa4f20a5f58f", "bridge": "br-int", "label": "tempest-device-tagging-net1-226643622", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422290f4-82", "ovs_interfaceid": "422290f4-824f-41ca-9a75-8031d21416a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80680073-3437-4be0-bf87-9ab62eb1320a", "address": "fa:16:3e:80:45:70", "network": {"id": "c98aea99-4504-4ee1-8c0f-1a43ac486ae2", "bridge": "br-int", "label": "tempest-device-tagging-net2-1935980718", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "fa7c759e2e974720a71b31ddbb2adba8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80680073-34", "ovs_interfaceid": "80680073-3437-4be0-bf87-9ab62eb1320a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[64920df9-6168-4fe6-b645-3c2b5f8ba3a2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:11 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:11 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:16:11 user nova-compute[71482]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e (non-flash)
Apr 12 09:16:11 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:16:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f934436e170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e'): ({'sdj'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Removing single pathed devices sdj {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0a48b2d3-e823-4fce-83e2-ad05616e609e req-26ab727a-b8a2-4c49-bf22-17a19cb8c243 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Detach interface failed, port_id=8403a9c1-5cfb-4f4a-bace-89f6a6130872, reason: Instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[843e0c4a-e21f-48cc-b175-3dbdaa331024]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1439c0f-9954-4ae2-85b8-6b7a226e3f17]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Flushing IO for device /dev/sdj {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb0c01f-a6cc-4fa5-90c6-2d838f58b370]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.040s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea15f22-d2a4-442f-aeac-f7c0a22d739c]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] SCSI volumes sdj have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b18f5b1-b8b6-4031-871b-201160343ce1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2da351-8463-43d1-a9bc-08eb21ac8538]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e, portal: 172.16.0.220,3260]
Apr 12 09:16:11 user nova-compute[71482]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e, portal: 172.16.0.220,3260] successful.
Apr 12 09:16:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df849839-f09e-44e6-8d36-832c074c558e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be34dde-ad66-43fe-8426-a5869f177e82]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] <== disconnect_volume: return (359ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:16:11 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Deleting instance files /opt/stack/data/nova/instances/6f800d18-d86c-4d82-9bb8-ce480c8835aa_del
Apr 12 09:16:11 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Deletion of /opt/stack/data/nova/instances/6f800d18-d86c-4d82-9bb8-ce480c8835aa_del complete
Apr 12 09:16:11 user nova-compute[71482]: INFO nova.compute.manager [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Took 3.47 seconds to destroy the instance on the hypervisor.
Apr 12 09:16:11 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:16:11 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:16:12 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:12 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Took 6.26 seconds to deallocate network for instance.
Apr 12 09:16:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-deleted-80680073-3437-4be0-bf87-9ab62eb1320a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-deleted-d221807b-9715-4917-99a5-eecefd100946 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-e60b36ec-fd63-4edf-aa0a-7608f1a4ab8d req-f8f9ec8a-ab8f-4e3d-87bd-14bff7e5d918 service nova] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Received event network-vif-deleted-422290f4-824f-41ca-9a75-8031d21416a5 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-deleted-be9408ea-445a-400a-a479-2c948b0e2a90 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:15 user nova-compute[71482]: INFO nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Neutron deleted interface be9408ea-445a-400a-a479-2c948b0e2a90; detaching it from the instance and deleting it from the info cache
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a6649c3-bb81-4507-8666-3d78390b0579", "address": "fa:16:3e:63:af:3c", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6649c3-bb", "ovs_interfaceid": "0a6649c3-bb81-4507-8666-3d78390b0579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:15 user nova-compute[71482]: INFO nova.compute.manager [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Took 2.84 seconds to detach 3 volumes for instance.
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Detach interface failed, port_id=be9408ea-445a-400a-a479-2c948b0e2a90, reason: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-deleted-0a6649c3-bb81-4507-8666-3d78390b0579 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:15 user nova-compute[71482]: INFO nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Neutron deleted interface 0a6649c3-bb81-4507-8666-3d78390b0579; detaching it from the instance and deleting it from the info cache
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4d0c163-2589-499a-8da8-68891a344baf", "address": "fa:16:3e:10:2a:53", "network": {"id": "772dd9a8-a15b-466c-b344-9bc31830f878", "bridge": "br-int", "label": "tempest-device-tagging-net2-1997934100", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4d0c163-25", "ovs_interfaceid": "f4d0c163-2589-499a-8da8-68891a344baf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Detach interface failed, port_id=0a6649c3-bb81-4507-8666-3d78390b0579, reason: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-deleted-f4d0c163-2589-499a-8da8-68891a344baf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:15 user nova-compute[71482]: INFO nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Neutron deleted interface f4d0c163-2589-499a-8da8-68891a344baf; detaching it from the instance and deleting it from the info cache
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "address": "fa:16:3e:d1:0f:a1", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.112", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebada7ae-e2", "ovs_interfaceid": "ebada7ae-e22b-4447-b0c2-ceccd02aa6bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Detach interface failed, port_id=f4d0c163-2589-499a-8da8-68891a344baf, reason: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-deleted-ebada7ae-e22b-4447-b0c2-ceccd02aa6bd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:15 user nova-compute[71482]: INFO nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Neutron deleted interface ebada7ae-e22b-4447-b0c2-ceccd02aa6bd; detaching it from the instance and deleting it from the info cache
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [{"id": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "address": "fa:16:3e:26:09:79", "network": {"id": "b85c5e98-acc1-431c-896a-2f20a3e0387b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1547572010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01bd698c-51", "ovs_interfaceid": "01bd698c-51c6-4aa0-963c-6e12f8b2a5ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "address": "fa:16:3e:b3:d3:78", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e85632b-00", "ovs_interfaceid": "8e85632b-0047-4c19-8d7a-745e21a1bb97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9f3437a2-863d-44c4-8d16-29e58aadf676", "address": "fa:16:3e:ef:4e:8e", "network": {"id": "f2ae7e3b-fd34-42a3-9df6-d8a1605a44a4", "bridge": "br-int", "label": "tempest-device-tagging-net1-1786145568", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5ce13a09e5b842b1997cee5123e0f167", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f3437a2-86", "ovs_interfaceid": "9f3437a2-863d-44c4-8d16-29e58aadf676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-05884f9a-f489-4011-a5b3-09dbaa986b01 req-15aeb99b-7d91-488e-bdab-6c7ca1e3299f service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Detach interface failed, port_id=ebada7ae-e22b-4447-b0c2-ceccd02aa6bd, reason: Instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:16:15 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:15 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Took 4.38 seconds to deallocate network for instance.
Apr 12 09:16:16 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:16:16 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:16:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:16 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Deleted allocations for instance a4d42e71-e21f-465d-b0a1-7cc5dbe0494c
Apr 12 09:16:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-aebcf7ec-bc06-424b-8269-46e0462bb12d tempest-TaggedBootDevicesTest_v242-683378533 tempest-TaggedBootDevicesTest_v242-683378533-project-member] Lock "a4d42e71-e21f-465d-b0a1-7cc5dbe0494c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.255s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-cc045452-ddf8-49e7-aaa7-eaf2e8733f46 req-868438fe-c092-48f4-983d-87f91a9c6729 service nova] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Received event network-vif-deleted-01bd698c-51c6-4aa0-963c-6e12f8b2a5ff {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:18 user nova-compute[71482]: INFO nova.compute.manager [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Took 2.44 seconds to detach 3 volumes for instance.
Apr 12 09:16:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:18 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:16:18 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:16:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:18 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Deleted allocations for instance 6f800d18-d86c-4d82-9bb8-ce480c8835aa
Apr 12 09:16:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4e9d7c0e-7b2e-43c4-a69f-c80ff56d0261 tempest-TaggedBootDevicesTest-1718738212 tempest-TaggedBootDevicesTest-1718738212-project-member] Lock "6f800d18-d86c-4d82-9bb8-ce480c8835aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.799s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:19 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290964.7519672, a4d42e71-e21f-465d-b0a1-7cc5dbe0494c => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:16:19 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] VM Stopped (Lifecycle Event)
Apr 12 09:16:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-48432f76-812a-4013-85ce-bb3c985e3ae4 None None] [instance: a4d42e71-e21f-465d-b0a1-7cc5dbe0494c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:16:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:24 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290969.9437716, 6f800d18-d86c-4d82-9bb8-ce480c8835aa => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:16:24 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] VM Stopped (Lifecycle Event)
Apr 12 09:16:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2c3ebba7-9885-4e90-9073-7166b37ef0b4 None None] [instance: 6f800d18-d86c-4d82-9bb8-ce480c8835aa] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:16:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:16:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:16:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:16:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received event network-changed-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Refreshing instance network info cache due to event network-changed-60f2af8d-b456-4efe-b146-cc700b68733e. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] Acquiring lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] Acquired lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Refreshing network info cache for port 60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:35 user nova-compute[71482]: INFO nova.compute.manager [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Terminating instance
Apr 12 09:16:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updated VIF entry in instance network info cache for port 60f2af8d-b456-4efe-b146-cc700b68733e. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updating instance_info_cache with network_info: [{"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f9e9ac11-6e2c-43b8-9189-906677ae7ea5 req-ff4c9d47-0701-440d-8d26-d8cb5b44cfe9 service nova] Releasing lock "refresh_cache-a5e42339-50fa-411c-94a1-c350727b7955" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:16:35 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Instance destroyed successfully.
Apr 12 09:16:35 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lazy-loading 'resources' on Instance uuid a5e42339-50fa-411c-94a1-c350727b7955 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-33778613',display_name='tempest-TestStampPattern-server-33778613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-33778613',id=11,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+fsSS3XTWnvMjjcXo2M/eSLvS9TQwtC5Vw9sxk2wzTZ75i0he3Eo6b0vT0HPmDlWDm3m80IrirjqBjUz0Z8GQDLK2hw+EpHpQKcspVFgKhBnSTs/WZpB6phNQXZtwf0w==',key_name='tempest-TestStampPattern-1475014031',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81d39dd859ed4684a659c79ca3ea3fb4',ramdisk_id='',reservation_id='r-bbio33zr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1126496829',owner_user_name='tempest-TestStampPattern-1126496829-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:12:43Z,user_data=None,user_id='e0440debc9af46e690788752e32f0912',uuid=a5e42339-50fa-411c-94a1-c350727b7955,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converting VIF {"id": "60f2af8d-b456-4efe-b146-cc700b68733e", "address": "fa:16:3e:d0:b5:14", "network": {"id": "891ebcc8-f6c9-4839-b624-dd5a9a1a7abd", "bridge": "br-int", "label": "tempest-TestStampPattern-1852446220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81d39dd859ed4684a659c79ca3ea3fb4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f2af8d-b4", "ovs_interfaceid": "60f2af8d-b456-4efe-b146-cc700b68733e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=60f2af8d-b456-4efe-b146-cc700b68733e,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2af8d-b4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG os_vif [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=60f2af8d-b456-4efe-b146-cc700b68733e,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2af8d-b4') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f2af8d-b4, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:36 user nova-compute[71482]: INFO os_vif [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:b5:14,bridge_name='br-int',has_traffic_filtering=True,id=60f2af8d-b456-4efe-b146-cc700b68733e,network=Network(891ebcc8-f6c9-4839-b624-dd5a9a1a7abd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f2af8d-b4')
Apr 12 09:16:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Deleting instance files /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955_del
Apr 12 09:16:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Deletion of /opt/stack/data/nova/instances/a5e42339-50fa-411c-94a1-c350727b7955_del complete
Apr 12 09:16:36 user nova-compute[71482]: INFO nova.compute.manager [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 09:16:36 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a5e42339-50fa-411c-94a1-c350727b7955] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:16:36 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received event network-vif-deleted-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:37 user nova-compute[71482]: INFO nova.compute.manager [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Neutron deleted interface 60f2af8d-b456-4efe-b146-cc700b68733e; detaching it from the instance and deleting it from the info cache
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.network.neutron [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:37 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Took 0.85 seconds to deallocate network for instance.
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-f74623e3-b360-44b7-8e12-86d74b3f6efc req-5ef8ce60-2a92-4108-b3e0-b843dc7b6ba8 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Detach interface failed, port_id=60f2af8d-b456-4efe-b146-cc700b68733e, reason: Instance a5e42339-50fa-411c-94a1-c350727b7955 could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received event network-vif-unplugged-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] No waiting events found dispatching network-vif-unplugged-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:37 user nova-compute[71482]: WARNING nova.compute.manager [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received unexpected event network-vif-unplugged-60f2af8d-b456-4efe-b146-cc700b68733e for instance with vm_state deleted and task_state None.
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received event network-vif-plugged-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Acquiring lock "a5e42339-50fa-411c-94a1-c350727b7955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] Lock "a5e42339-50fa-411c-94a1-c350727b7955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] No waiting events found dispatching network-vif-plugged-60f2af8d-b456-4efe-b146-cc700b68733e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:37 user nova-compute[71482]: WARNING nova.compute.manager [req-bea600e3-9325-4b80-838f-e6c497a781e1 req-b72ad01f-eda7-4e4e-a8c3-22663ed7e5b1 service nova] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Received unexpected event network-vif-plugged-60f2af8d-b456-4efe-b146-cc700b68733e for instance with vm_state deleted and task_state None.
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquired lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.network.neutron [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'info_cache' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:37 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Deleted allocations for instance a5e42339-50fa-411c-94a1-c350727b7955
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b7b9f14c-c965-4a04-a4fa-f08d14e80006 tempest-TestStampPattern-1126496829 tempest-TestStampPattern-1126496829-project-member] Lock "a5e42339-50fa-411c-94a1-c350727b7955" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.network.neutron [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updating instance_info_cache with network_info: [{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Releasing lock "refresh_cache-f683bc12-8fca-47de-b28e-a0070e77b387" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:16:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance destroyed successfully.
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'resources' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-9128142',display_name='tempest-AttachVolumeTestJSON-server-9128142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-9128142',id=5,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w==',key_name='tempest-keypair-2058620837',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-hp2b9h01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=f683bc12-8fca-47de-b28e-a0070e77b387,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG os_vif [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape957a8ce-db, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:37 user nova-compute[71482]: INFO os_vif [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db')
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Start _get_guest_xml network_info=[{"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'numa_topology' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:37 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:16:37 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'vcpu_model' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-9128142',display_name='tempest-AttachVolumeTestJSON-server-9128142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-9128142',id=5,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w==',key_name='tempest-keypair-2058620837',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-hp2b9h01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:14:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=f683bc12-8fca-47de-b28e-a0070e77b387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'pci_devices' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:16:37 user nova-compute[71482]:   <uuid>f683bc12-8fca-47de-b28e-a0070e77b387</uuid>
Apr 12 09:16:37 user nova-compute[71482]:   <name>instance-00000005</name>
Apr 12 09:16:37 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:16:37 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:16:37 user nova-compute[71482]:   <metadata>
Apr 12 09:16:37 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:16:37 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:16:37 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeTestJSON-server-9128142</nova:name>
Apr 12 09:16:37 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:16:37</nova:creationTime>
Apr 12 09:16:37 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:16:37 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:16:37 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:16:37 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:16:37 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:16:37 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:16:37 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:16:37 user nova-compute[71482]:       <nova:owner>
Apr 12 09:16:37 user nova-compute[71482]:         <nova:user uuid="2a3731bf575c44d89211709cb07060b7">tempest-AttachVolumeTestJSON-1252670961-project-member</nova:user>
Apr 12 09:16:37 user nova-compute[71482]:         <nova:project uuid="23e6ce78ce3d4eb5b4bbb307665c3670">tempest-AttachVolumeTestJSON-1252670961</nova:project>
Apr 12 09:16:37 user nova-compute[71482]:       </nova:owner>
Apr 12 09:16:37 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:16:37 user nova-compute[71482]:       <nova:ports>
Apr 12 09:16:37 user nova-compute[71482]:         <nova:port uuid="e957a8ce-db60-4c11-8fcf-6b88d77e8e4f">
Apr 12 09:16:37 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 09:16:37 user nova-compute[71482]:         </nova:port>
Apr 12 09:16:37 user nova-compute[71482]:       </nova:ports>
Apr 12 09:16:37 user nova-compute[71482]:     </nova:instance>
Apr 12 09:16:37 user nova-compute[71482]:   </metadata>
Apr 12 09:16:37 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:16:37 user nova-compute[71482]:     <system>
Apr 12 09:16:37 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:16:37 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:16:37 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:16:37 user nova-compute[71482]:       <entry name="serial">f683bc12-8fca-47de-b28e-a0070e77b387</entry>
Apr 12 09:16:37 user nova-compute[71482]:       <entry name="uuid">f683bc12-8fca-47de-b28e-a0070e77b387</entry>
Apr 12 09:16:37 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:16:37 user nova-compute[71482]:     </system>
Apr 12 09:16:37 user nova-compute[71482]:   </sysinfo>
Apr 12 09:16:37 user nova-compute[71482]:   <os>
Apr 12 09:16:37 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:16:37 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:16:37 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:16:37 user nova-compute[71482]:   </os>
Apr 12 09:16:37 user nova-compute[71482]:   <features>
Apr 12 09:16:37 user nova-compute[71482]:     <acpi/>
Apr 12 09:16:37 user nova-compute[71482]:     <apic/>
Apr 12 09:16:37 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:16:37 user nova-compute[71482]:   </features>
Apr 12 09:16:37 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:16:37 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:16:37 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:16:37 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:16:37 user nova-compute[71482]:   </clock>
Apr 12 09:16:37 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:16:37 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:16:37 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:16:37 user nova-compute[71482]:   </cpu>
Apr 12 09:16:37 user nova-compute[71482]:   <devices>
Apr 12 09:16:37 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:16:37 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:16:37 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk"/>
Apr 12 09:16:37 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:16:37 user nova-compute[71482]:     </disk>
Apr 12 09:16:37 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:16:37 user nova-compute[71482]:       <mac address="fa:16:3e:f3:e5:20"/>
Apr 12 09:16:37 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:16:37 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:16:37 user nova-compute[71482]:       <target dev="tape957a8ce-db"/>
Apr 12 09:16:37 user nova-compute[71482]:     </interface>
Apr 12 09:16:37 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:16:37 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/console.log" append="off"/>
Apr 12 09:16:37 user nova-compute[71482]:     </serial>
Apr 12 09:16:37 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:16:37 user nova-compute[71482]:     <video>
Apr 12 09:16:37 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:16:37 user nova-compute[71482]:     </video>
Apr 12 09:16:37 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:16:37 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:16:37 user nova-compute[71482]:     </rng>
Apr 12 09:16:37 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:16:37 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:16:37 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:16:37 user nova-compute[71482]:     </memballoon>
Apr 12 09:16:37 user nova-compute[71482]:   </devices>
Apr 12 09:16:37 user nova-compute[71482]: </domain>
Apr 12 09:16:37 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:16:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'trusted_certs' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.127s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Cannot resize image /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'migration_context' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-9128142',display_name='tempest-AttachVolumeTestJSON-server-9128142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-9128142',id=5,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w==',key_name='tempest-keypair-2058620837',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-hp2b9h01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:14:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=f683bc12-8fca-47de-b28e-a0070e77b387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG os_vif [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape957a8ce-db, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape957a8ce-db, col_values=(('external_ids', {'iface-id': 'e957a8ce-db60-4c11-8fcf-6b88d77e8e4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:e5:20', 'vm-uuid': 'f683bc12-8fca-47de-b28e-a0070e77b387'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:38 user nova-compute[71482]: INFO os_vif [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db')
Apr 12 09:16:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:40 user nova-compute[71482]: WARNING nova.compute.manager [req-c842a7fd-0e56-4056-b31a-dce99556044a req-7541d996-e13f-4c83-b7f6-70246f2e7f7c service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state stopped and task_state powering-on.
Apr 12 09:16:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291002.014739, f683bc12-8fca-47de-b28e-a0070e77b387 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:16:42 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] VM Resumed (Lifecycle Event)
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:16:42 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance rebooted successfully.
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-5e899a50-a76d-4d7b-bf70-c3d3b7947459 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:16:42 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291002.0222116, f683bc12-8fca-47de-b28e-a0070e77b387 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:16:42 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] VM Started (Lifecycle Event)
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:16:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:16:42 user nova-compute[71482]: WARNING nova.compute.manager [req-eebf9146-698d-4240-8ecb-2d16159aef47 req-ba54736d-0d4d-407c-a1a7-fe188c715419 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state active and task_state None.
Apr 12 09:16:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:16:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:16:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:16:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:16:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:16:46 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid a569c652-6b15-4244-b011-1d09fbdd4281 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:16:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updating instance_info_cache with network_info: [{"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:16:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:16:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:16:47 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:47 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:47 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:47 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:47 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:16:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:49 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:50 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681290995.9936044, a5e42339-50fa-411c-94a1-c350727b7955 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:16:50 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a5e42339-50fa-411c-94a1-c350727b7955] VM Stopped (Lifecycle Event)
Apr 12 09:16:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-ce97b25a-ce85-43e6-a08a-90b07e01dc1b None None] [instance: a5e42339-50fa-411c-94a1-c350727b7955] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:16:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:16:56 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:16:56 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8051MB free_disk=26.33062744140625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f683bc12-8fca-47de-b28e-a0070e77b387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:16:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:16:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "e442604c-86f4-45e1-9407-1764133852ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e442604c-86f4-45e1-9407-1764133852ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:17:11 user nova-compute[71482]: INFO nova.compute.claims [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Claim successful on node user
Apr 12 09:17:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:17:11 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:17:11 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Creating image(s)
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "/opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "/opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "/opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG nova.policy [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk 1073741824" returned: 0 in 0.051s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.164s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Cannot resize image /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG nova.objects.instance [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'migration_context' on Instance uuid e442604c-86f4-45e1-9407-1764133852ef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Ensure instance console log exists: /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG nova.network.neutron [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Successfully created port: c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG nova.network.neutron [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Successfully updated port: c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "refresh_cache-e442604c-86f4-45e1-9407-1764133852ef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquired lock "refresh_cache-e442604c-86f4-45e1-9407-1764133852ef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG nova.network.neutron [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received event network-changed-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Refreshing instance network info cache due to event network-changed-c456f016-a187-4f16-9a25-2ae020e10413. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] Acquiring lock "refresh_cache-e442604c-86f4-45e1-9407-1764133852ef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:13 user nova-compute[71482]: DEBUG nova.network.neutron [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.network.neutron [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Updating instance_info_cache with network_info: [{"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Releasing lock "refresh_cache-e442604c-86f4-45e1-9407-1764133852ef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Instance network_info: |[{"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] Acquired lock "refresh_cache-e442604c-86f4-45e1-9407-1764133852ef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Refreshing network info cache for port c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Start _get_guest_xml network_info=[{"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:17:14 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:14 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-206066750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-206066750',id=18,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-app6s433',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:12Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=e442604c-86f4-45e1-9407-1764133852ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=c456f016-a187-4f16-9a25-2ae020e10413,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc456f016-a1') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.objects.instance [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'pci_devices' on Instance uuid e442604c-86f4-45e1-9407-1764133852ef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:17:14 user nova-compute[71482]:   <uuid>e442604c-86f4-45e1-9407-1764133852ef</uuid>
Apr 12 09:17:14 user nova-compute[71482]:   <name>instance-00000012</name>
Apr 12 09:17:14 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:17:14 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:17:14 user nova-compute[71482]:   <metadata>
Apr 12 09:17:14 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:17:14 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:17:14 user nova-compute[71482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-206066750</nova:name>
Apr 12 09:17:14 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:17:14</nova:creationTime>
Apr 12 09:17:14 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:17:14 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:17:14 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:17:14 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:17:14 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:17:14 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:17:14 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:17:14 user nova-compute[71482]:       <nova:owner>
Apr 12 09:17:14 user nova-compute[71482]:         <nova:user uuid="cc51704e74b045ad9733a43aec982390">tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member</nova:user>
Apr 12 09:17:14 user nova-compute[71482]:         <nova:project uuid="a6ce4a0f4dad40c18fd8a83470c15f05">tempest-ServerBootFromVolumeStableRescueTest-1244466684</nova:project>
Apr 12 09:17:14 user nova-compute[71482]:       </nova:owner>
Apr 12 09:17:14 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:17:14 user nova-compute[71482]:       <nova:ports>
Apr 12 09:17:14 user nova-compute[71482]:         <nova:port uuid="c456f016-a187-4f16-9a25-2ae020e10413">
Apr 12 09:17:14 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 09:17:14 user nova-compute[71482]:         </nova:port>
Apr 12 09:17:14 user nova-compute[71482]:       </nova:ports>
Apr 12 09:17:14 user nova-compute[71482]:     </nova:instance>
Apr 12 09:17:14 user nova-compute[71482]:   </metadata>
Apr 12 09:17:14 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:17:14 user nova-compute[71482]:     <system>
Apr 12 09:17:14 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:17:14 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:17:14 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:17:14 user nova-compute[71482]:       <entry name="serial">e442604c-86f4-45e1-9407-1764133852ef</entry>
Apr 12 09:17:14 user nova-compute[71482]:       <entry name="uuid">e442604c-86f4-45e1-9407-1764133852ef</entry>
Apr 12 09:17:14 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:17:14 user nova-compute[71482]:     </system>
Apr 12 09:17:14 user nova-compute[71482]:   </sysinfo>
Apr 12 09:17:14 user nova-compute[71482]:   <os>
Apr 12 09:17:14 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:17:14 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:17:14 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:17:14 user nova-compute[71482]:   </os>
Apr 12 09:17:14 user nova-compute[71482]:   <features>
Apr 12 09:17:14 user nova-compute[71482]:     <acpi/>
Apr 12 09:17:14 user nova-compute[71482]:     <apic/>
Apr 12 09:17:14 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:17:14 user nova-compute[71482]:   </features>
Apr 12 09:17:14 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:17:14 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:17:14 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:17:14 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:17:14 user nova-compute[71482]:   </clock>
Apr 12 09:17:14 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:17:14 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:17:14 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:17:14 user nova-compute[71482]:   </cpu>
Apr 12 09:17:14 user nova-compute[71482]:   <devices>
Apr 12 09:17:14 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:17:14 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:17:14 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk"/>
Apr 12 09:17:14 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:17:14 user nova-compute[71482]:     </disk>
Apr 12 09:17:14 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:17:14 user nova-compute[71482]:       <mac address="fa:16:3e:29:21:2f"/>
Apr 12 09:17:14 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:14 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:17:14 user nova-compute[71482]:       <target dev="tapc456f016-a1"/>
Apr 12 09:17:14 user nova-compute[71482]:     </interface>
Apr 12 09:17:14 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:17:14 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/console.log" append="off"/>
Apr 12 09:17:14 user nova-compute[71482]:     </serial>
Apr 12 09:17:14 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:17:14 user nova-compute[71482]:     <video>
Apr 12 09:17:14 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:14 user nova-compute[71482]:     </video>
Apr 12 09:17:14 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:17:14 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:17:14 user nova-compute[71482]:     </rng>
Apr 12 09:17:14 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:17:14 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:17:14 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:17:14 user nova-compute[71482]:     </memballoon>
Apr 12 09:17:14 user nova-compute[71482]:   </devices>
Apr 12 09:17:14 user nova-compute[71482]: </domain>
Apr 12 09:17:14 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-206066750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-206066750',id=18,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-app6s433',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:12Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=e442604c-86f4-45e1-9407-1764133852ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=c456f016-a187-4f16-9a25-2ae020e10413,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc456f016-a1') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG os_vif [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=c456f016-a187-4f16-9a25-2ae020e10413,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc456f016-a1') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc456f016-a1, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc456f016-a1, col_values=(('external_ids', {'iface-id': 'c456f016-a187-4f16-9a25-2ae020e10413', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:21:2f', 'vm-uuid': 'e442604c-86f4-45e1-9407-1764133852ef'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:14 user nova-compute[71482]: INFO os_vif [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=c456f016-a187-4f16-9a25-2ae020e10413,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc456f016-a1')
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No VIF found with MAC fa:16:3e:29:21:2f, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Updated VIF entry in instance network info cache for port c456f016-a187-4f16-9a25-2ae020e10413. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Updating instance_info_cache with network_info: [{"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-26c5b418-48e5-4904-9e08-b8bf3a8975cf req-7c7ccf2d-1c5c-4196-a3a3-5558eaef11a3 service nova] Releasing lock "refresh_cache-e442604c-86f4-45e1-9407-1764133852ef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:16 user nova-compute[71482]: DEBUG nova.compute.manager [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received event network-vif-plugged-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] Acquiring lock "e442604c-86f4-45e1-9407-1764133852ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:16 user nova-compute[71482]: DEBUG nova.compute.manager [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] No waiting events found dispatching network-vif-plugged-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:16 user nova-compute[71482]: WARNING nova.compute.manager [req-ddc4df47-4cb3-4bf4-9bbd-4f9c4fb3d02e req-ae7c5d64-d7f2-4911-9b70-7c2269f31595 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received unexpected event network-vif-plugged-c456f016-a187-4f16-9a25-2ae020e10413 for instance with vm_state building and task_state spawning.
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291038.0951393, e442604c-86f4-45e1-9407-1764133852ef => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:18 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] VM Resumed (Lifecycle Event)
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:17:18 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: e442604c-86f4-45e1-9407-1764133852ef] Instance spawned successfully.
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:18 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291038.096838, e442604c-86f4-45e1-9407-1764133852ef => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:18 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] VM Started (Lifecycle Event)
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:18 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:17:18 user nova-compute[71482]: INFO nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Took 6.54 seconds to spawn the instance on the hypervisor.
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received event network-vif-plugged-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] Acquiring lock "e442604c-86f4-45e1-9407-1764133852ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] No waiting events found dispatching network-vif-plugged-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:18 user nova-compute[71482]: WARNING nova.compute.manager [req-a52b2d71-2c19-4edf-9b30-0827cd05ec7a req-28c41218-d269-4668-9b35-3638d0231d8e service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received unexpected event network-vif-plugged-c456f016-a187-4f16-9a25-2ae020e10413 for instance with vm_state building and task_state spawning.
Apr 12 09:17:18 user nova-compute[71482]: INFO nova.compute.manager [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Took 7.27 seconds to build instance.
Apr 12 09:17:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-fdb0c658-51cd-4e15-9cc7-7a7a9a654f85 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e442604c-86f4-45e1-9407-1764133852ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.452s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:17:27 user nova-compute[71482]: INFO nova.compute.claims [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Claim successful on node user
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:17:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.policy [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:17:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Creating image(s)
Apr 12 09:17:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.165s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk 1073741824" returned: 0 in 0.072s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.179s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Cannot resize image /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG nova.objects.instance [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'migration_context' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Ensure instance console log exists: /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:28 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Successfully created port: 1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Successfully updated port: 1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquired lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-changed-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Refreshing instance network info cache due to event network-changed-1cf7a879-f705-467c-af44-2b2d40216cef. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] Acquiring lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating instance_info_cache with network_info: [{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Releasing lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance network_info: |[{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] Acquired lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.network.neutron [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Refreshing network info cache for port 1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Start _get_guest_xml network_info=[{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:17:30 user nova-compute[71482]: INFO nova.compute.claims [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Claim successful on node user
Apr 12 09:17:30 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:30 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325803830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325803830',id=19,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4JkdmcZevwkBRIvOxZXR/GY5jcnavNiZ74hKGbOyliYHO5bVun8yU8w+4IBWoQC5ayotvjMWHRPPGubYFeG7cJoQLiULRqOwjpOnp0kPQmpgv3dBxk2vLFWpUFCoUImw==',key_name='tempest-keypair-501602451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-ngwjnp8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=25232386-f51a-434b-9280-c4dd30b55f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.objects.instance [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'pci_devices' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:17:30 user nova-compute[71482]:   <uuid>25232386-f51a-434b-9280-c4dd30b55f3d</uuid>
Apr 12 09:17:30 user nova-compute[71482]:   <name>instance-00000013</name>
Apr 12 09:17:30 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:17:30 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:17:30 user nova-compute[71482]:   <metadata>
Apr 12 09:17:30 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:17:30 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:17:30 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-325803830</nova:name>
Apr 12 09:17:30 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:17:30</nova:creationTime>
Apr 12 09:17:30 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:17:30 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:17:30 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:17:30 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:17:30 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:17:30 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:17:30 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:17:30 user nova-compute[71482]:       <nova:owner>
Apr 12 09:17:30 user nova-compute[71482]:         <nova:user uuid="d76daece06a943668e6c1c3c2c57ebaa">tempest-AttachVolumeShelveTestJSON-72439030-project-member</nova:user>
Apr 12 09:17:30 user nova-compute[71482]:         <nova:project uuid="6ebfa64bb5194b859821a77de6805d2d">tempest-AttachVolumeShelveTestJSON-72439030</nova:project>
Apr 12 09:17:30 user nova-compute[71482]:       </nova:owner>
Apr 12 09:17:30 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:17:30 user nova-compute[71482]:       <nova:ports>
Apr 12 09:17:30 user nova-compute[71482]:         <nova:port uuid="1cf7a879-f705-467c-af44-2b2d40216cef">
Apr 12 09:17:30 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:17:30 user nova-compute[71482]:         </nova:port>
Apr 12 09:17:30 user nova-compute[71482]:       </nova:ports>
Apr 12 09:17:30 user nova-compute[71482]:     </nova:instance>
Apr 12 09:17:30 user nova-compute[71482]:   </metadata>
Apr 12 09:17:30 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:17:30 user nova-compute[71482]:     <system>
Apr 12 09:17:30 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:17:30 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:17:30 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:17:30 user nova-compute[71482]:       <entry name="serial">25232386-f51a-434b-9280-c4dd30b55f3d</entry>
Apr 12 09:17:30 user nova-compute[71482]:       <entry name="uuid">25232386-f51a-434b-9280-c4dd30b55f3d</entry>
Apr 12 09:17:30 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:17:30 user nova-compute[71482]:     </system>
Apr 12 09:17:30 user nova-compute[71482]:   </sysinfo>
Apr 12 09:17:30 user nova-compute[71482]:   <os>
Apr 12 09:17:30 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:17:30 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:17:30 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:17:30 user nova-compute[71482]:   </os>
Apr 12 09:17:30 user nova-compute[71482]:   <features>
Apr 12 09:17:30 user nova-compute[71482]:     <acpi/>
Apr 12 09:17:30 user nova-compute[71482]:     <apic/>
Apr 12 09:17:30 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:17:30 user nova-compute[71482]:   </features>
Apr 12 09:17:30 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:17:30 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:17:30 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:17:30 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:17:30 user nova-compute[71482]:   </clock>
Apr 12 09:17:30 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:17:30 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:17:30 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:17:30 user nova-compute[71482]:   </cpu>
Apr 12 09:17:30 user nova-compute[71482]:   <devices>
Apr 12 09:17:30 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:17:30 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:17:30 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk"/>
Apr 12 09:17:30 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:17:30 user nova-compute[71482]:     </disk>
Apr 12 09:17:30 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:17:30 user nova-compute[71482]:       <mac address="fa:16:3e:d5:74:bc"/>
Apr 12 09:17:30 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:30 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:17:30 user nova-compute[71482]:       <target dev="tap1cf7a879-f7"/>
Apr 12 09:17:30 user nova-compute[71482]:     </interface>
Apr 12 09:17:30 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:17:30 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/console.log" append="off"/>
Apr 12 09:17:30 user nova-compute[71482]:     </serial>
Apr 12 09:17:30 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:17:30 user nova-compute[71482]:     <video>
Apr 12 09:17:30 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:30 user nova-compute[71482]:     </video>
Apr 12 09:17:30 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:17:30 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:17:30 user nova-compute[71482]:     </rng>
Apr 12 09:17:30 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:17:30 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:17:30 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:17:30 user nova-compute[71482]:     </memballoon>
Apr 12 09:17:30 user nova-compute[71482]:   </devices>
Apr 12 09:17:30 user nova-compute[71482]: </domain>
Apr 12 09:17:30 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325803830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325803830',id=19,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4JkdmcZevwkBRIvOxZXR/GY5jcnavNiZ74hKGbOyliYHO5bVun8yU8w+4IBWoQC5ayotvjMWHRPPGubYFeG7cJoQLiULRqOwjpOnp0kPQmpgv3dBxk2vLFWpUFCoUImw==',key_name='tempest-keypair-501602451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-ngwjnp8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=25232386-f51a-434b-9280-c4dd30b55f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG os_vif [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cf7a879-f7, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1cf7a879-f7, col_values=(('external_ids', {'iface-id': '1cf7a879-f705-467c-af44-2b2d40216cef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:74:bc', 'vm-uuid': '25232386-f51a-434b-9280-c4dd30b55f3d'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:30 user nova-compute[71482]: INFO os_vif [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7')
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] No VIF found with MAC fa:16:3e:d5:74:bc, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:17:30 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.policy [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:17:30 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Creating image(s)
Apr 12 09:17:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "/opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "/opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "/opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:30 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.185s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk 1073741824" returned: 0 in 0.053s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.network.neutron [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updated VIF entry in instance network info cache for port 1cf7a879-f705-467c-af44-2b2d40216cef. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.network.neutron [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating instance_info_cache with network_info: [{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-311112d1-68c1-4c6c-aaa2-d7b522734a35 req-fcc7d321-b79b-4ee1-9d2d-a03379e0495e service nova] Releasing lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Cannot resize image /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'migration_context' on Instance uuid 9691009c-8aca-4347-8e46-c5bdda13aa3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:17:31 user nova-compute[71482]: INFO nova.compute.claims [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Claim successful on node user
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Ensure instance console log exists: /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:31 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Successfully created port: 3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] No waiting events found dispatching network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:32 user nova-compute[71482]: WARNING nova.compute.manager [req-47233afb-40b7-4a9e-b517-9112b242b037 req-435fc5d1-b553-4948-9ba8-e9f496da9643 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received unexpected event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef for instance with vm_state building and task_state spawning.
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.717s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:17:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:17:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.policy [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f6b983634234693ba04a3097c2a129b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c3cc8ab6ab244b1badb6fea347d64ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:17:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Creating image(s)
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.165s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.178s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk 1073741824" returned: 0 in 0.073s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'flavor' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Successfully updated port: 3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "refresh_cache-9691009c-8aca-4347-8e46-c5bdda13aa3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquired lock "refresh_cache-9691009c-8aca-4347-8e46-c5bdda13aa3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received event network-changed-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Refreshing instance network info cache due to event network-changed-3fe5d678-976e-467d-888f-4575a3cc2efe. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] Acquiring lock "refresh_cache-9691009c-8aca-4347-8e46-c5bdda13aa3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Cannot resize image /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'migration_context' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Ensure instance console log exists: /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:33 user nova-compute[71482]: INFO nova.compute.manager [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attaching volume 7d6b141c-5f82-4aed-b319-8579a78c6c58 to /dev/vdb
Apr 12 09:17:33 user nova-compute[71482]: DEBUG os_brick.utils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c93ff54-496c-4b39-b4a8-b3af4844d0bb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7119e9c-20a1-44f7-aa16-24e3cee44196]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[04907224-ec01-43f8-acef-5d0492ba7ef7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[74309973-85cd-4d99-bb77-84a5e265ef5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:17:33 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8fd0b-46b4-489e-9ec3-7a5f6fbe6a62]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG os_brick.utils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating existing volume attachment record: 9c2dfbf0-cf16-40e1-a427-ff65eb7fee72 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Successfully created port: a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Updating instance_info_cache with network_info: [{"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Releasing lock "refresh_cache-9691009c-8aca-4347-8e46-c5bdda13aa3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Instance network_info: |[{"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] Acquired lock "refresh_cache-9691009c-8aca-4347-8e46-c5bdda13aa3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.neutron [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Refreshing network info cache for port 3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Start _get_guest_xml network_info=[{"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:17:33 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:33 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1730277833',display_name='tempest-AttachVolumeNegativeTest-server-1730277833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1730277833',id=20,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcgOlYUwNuWHn3k/8NhVfKcsRRf00AtvCUtT94690EyQkY6DJedMcCl0px8XoQgNE4fdJsdkSkN6tuvI98c71siFzbUZTepADTU9efkAxglWffFn8akoG6jZa+wPJijqg==',key_name='tempest-keypair-65745046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-gk85kmil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=9691009c-8aca-4347-8e46-c5bdda13aa3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=3fe5d678-976e-467d-888f-4575a3cc2efe,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe5d678-97') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'pci_devices' on Instance uuid 9691009c-8aca-4347-8e46-c5bdda13aa3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:17:33 user nova-compute[71482]:   <uuid>9691009c-8aca-4347-8e46-c5bdda13aa3d</uuid>
Apr 12 09:17:33 user nova-compute[71482]:   <name>instance-00000014</name>
Apr 12 09:17:33 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:17:33 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:17:33 user nova-compute[71482]:   <metadata>
Apr 12 09:17:33 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:17:33 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:17:33 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1730277833</nova:name>
Apr 12 09:17:33 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:17:33</nova:creationTime>
Apr 12 09:17:33 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:17:33 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:17:33 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:17:33 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:17:33 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:17:33 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:17:33 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:17:33 user nova-compute[71482]:       <nova:owner>
Apr 12 09:17:33 user nova-compute[71482]:         <nova:user uuid="5f91fed06f9547d29125f38fe2d47221">tempest-AttachVolumeNegativeTest-395431601-project-member</nova:user>
Apr 12 09:17:33 user nova-compute[71482]:         <nova:project uuid="37b4beaf457f4120bcbcd2b033d5c3db">tempest-AttachVolumeNegativeTest-395431601</nova:project>
Apr 12 09:17:33 user nova-compute[71482]:       </nova:owner>
Apr 12 09:17:33 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:17:33 user nova-compute[71482]:       <nova:ports>
Apr 12 09:17:33 user nova-compute[71482]:         <nova:port uuid="3fe5d678-976e-467d-888f-4575a3cc2efe">
Apr 12 09:17:33 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 09:17:33 user nova-compute[71482]:         </nova:port>
Apr 12 09:17:33 user nova-compute[71482]:       </nova:ports>
Apr 12 09:17:33 user nova-compute[71482]:     </nova:instance>
Apr 12 09:17:33 user nova-compute[71482]:   </metadata>
Apr 12 09:17:33 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:17:33 user nova-compute[71482]:     <system>
Apr 12 09:17:33 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:17:33 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:17:33 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:17:33 user nova-compute[71482]:       <entry name="serial">9691009c-8aca-4347-8e46-c5bdda13aa3d</entry>
Apr 12 09:17:33 user nova-compute[71482]:       <entry name="uuid">9691009c-8aca-4347-8e46-c5bdda13aa3d</entry>
Apr 12 09:17:33 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:17:33 user nova-compute[71482]:     </system>
Apr 12 09:17:33 user nova-compute[71482]:   </sysinfo>
Apr 12 09:17:33 user nova-compute[71482]:   <os>
Apr 12 09:17:33 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:17:33 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:17:33 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:17:33 user nova-compute[71482]:   </os>
Apr 12 09:17:33 user nova-compute[71482]:   <features>
Apr 12 09:17:33 user nova-compute[71482]:     <acpi/>
Apr 12 09:17:33 user nova-compute[71482]:     <apic/>
Apr 12 09:17:33 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:17:33 user nova-compute[71482]:   </features>
Apr 12 09:17:33 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:17:33 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:17:33 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:17:33 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:17:33 user nova-compute[71482]:   </clock>
Apr 12 09:17:33 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:17:33 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:17:33 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:17:33 user nova-compute[71482]:   </cpu>
Apr 12 09:17:33 user nova-compute[71482]:   <devices>
Apr 12 09:17:33 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:17:33 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:17:33 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk"/>
Apr 12 09:17:33 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:17:33 user nova-compute[71482]:     </disk>
Apr 12 09:17:33 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:17:33 user nova-compute[71482]:       <mac address="fa:16:3e:bb:c0:46"/>
Apr 12 09:17:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:33 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:17:33 user nova-compute[71482]:       <target dev="tap3fe5d678-97"/>
Apr 12 09:17:33 user nova-compute[71482]:     </interface>
Apr 12 09:17:33 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:17:33 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/console.log" append="off"/>
Apr 12 09:17:33 user nova-compute[71482]:     </serial>
Apr 12 09:17:33 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:17:33 user nova-compute[71482]:     <video>
Apr 12 09:17:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:33 user nova-compute[71482]:     </video>
Apr 12 09:17:33 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:17:33 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:17:33 user nova-compute[71482]:     </rng>
Apr 12 09:17:33 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:17:33 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:17:33 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:17:33 user nova-compute[71482]:     </memballoon>
Apr 12 09:17:33 user nova-compute[71482]:   </devices>
Apr 12 09:17:33 user nova-compute[71482]: </domain>
Apr 12 09:17:33 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1730277833',display_name='tempest-AttachVolumeNegativeTest-server-1730277833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1730277833',id=20,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcgOlYUwNuWHn3k/8NhVfKcsRRf00AtvCUtT94690EyQkY6DJedMcCl0px8XoQgNE4fdJsdkSkN6tuvI98c71siFzbUZTepADTU9efkAxglWffFn8akoG6jZa+wPJijqg==',key_name='tempest-keypair-65745046',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-gk85kmil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=9691009c-8aca-4347-8e46-c5bdda13aa3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=3fe5d678-976e-467d-888f-4575a3cc2efe,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe5d678-97') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG os_vif [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=3fe5d678-976e-467d-888f-4575a3cc2efe,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe5d678-97') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fe5d678-97, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3fe5d678-97, col_values=(('external_ids', {'iface-id': '3fe5d678-976e-467d-888f-4575a3cc2efe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:c0:46', 'vm-uuid': '9691009c-8aca-4347-8e46-c5bdda13aa3d'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:17:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:33 user nova-compute[71482]: INFO os_vif [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=3fe5d678-976e-467d-888f-4575a3cc2efe,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe5d678-97')
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No VIF found with MAC fa:16:3e:bb:c0:46, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] No waiting events found dispatching network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:34 user nova-compute[71482]: WARNING nova.compute.manager [req-2e76c72e-a710-40a2-80a3-4c6e51daf083 req-23b1891d-6451-4f6b-aa99-4c2d162b52ac service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received unexpected event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef for instance with vm_state building and task_state spawning.
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291054.1111367, 25232386-f51a-434b-9280-c4dd30b55f3d => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:34 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] VM Resumed (Lifecycle Event)
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance spawned successfully.
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:34 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291054.1223354, 25232386-f51a-434b-9280-c4dd30b55f3d => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:34 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] VM Started (Lifecycle Event)
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:34 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:17:34 user nova-compute[71482]: INFO nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Took 6.37 seconds to spawn the instance on the hypervisor.
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:34 user nova-compute[71482]: INFO nova.compute.manager [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Took 7.34 seconds to build instance.
Apr 12 09:17:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d79b6692-d134-4760-8b25-e0f1502f6107 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.479s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.network.neutron [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Updated VIF entry in instance network info cache for port 3fe5d678-976e-467d-888f-4575a3cc2efe. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.network.neutron [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Updating instance_info_cache with network_info: [{"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b5f1c79-7b87-4e2a-b72b-0eb2906e9e39 req-b337d218-3c8a-4ca3-bd25-170dbda8013e service nova] Releasing lock "refresh_cache-9691009c-8aca-4347-8e46-c5bdda13aa3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Successfully updated port: a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquired lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:17:34 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating instance_info_cache with network_info: [{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-changed-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Refreshing instance network info cache due to event network-changed-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] Acquiring lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Releasing lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Instance network_info: |[{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] Acquired lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Refreshing network info cache for port a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Start _get_guest_xml network_info=[{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:17:35 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:35 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1045691490',display_name='tempest-ServerRescueNegativeTestJSON-server-1045691490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1045691490',id=21,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRFQGCKpi8fjGcdpMDws7TZ+hZpwQGB4rtL60LdXbaRXqJvmTcXhTPGYdQ+Z42mEAB4P05g7T0Z0J2ARvc+I4t9vDocY1CSO+itTj8pMWaDXEEILwFmJvFWolS0ihRs3g==',key_name='tempest-keypair-1774942187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-i1bjiuzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b983634234693ba04a3097c2a129b',uuid=0fe0c221-d660-4a7e-9fd8-5d9b49c659d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:07:99,bridge_name='br-int',has_traffic_filtering=True,id=a0e06b9c-27fc-47a2-a5d1-0da741a09eaa,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e06b9c-27') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:17:35 user nova-compute[71482]:   <uuid>0fe0c221-d660-4a7e-9fd8-5d9b49c659d0</uuid>
Apr 12 09:17:35 user nova-compute[71482]:   <name>instance-00000015</name>
Apr 12 09:17:35 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:17:35 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:17:35 user nova-compute[71482]:   <metadata>
Apr 12 09:17:35 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:17:35 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:17:35 user nova-compute[71482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1045691490</nova:name>
Apr 12 09:17:35 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:17:35</nova:creationTime>
Apr 12 09:17:35 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:17:35 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:17:35 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:17:35 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:17:35 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:17:35 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:17:35 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:17:35 user nova-compute[71482]:       <nova:owner>
Apr 12 09:17:35 user nova-compute[71482]:         <nova:user uuid="7f6b983634234693ba04a3097c2a129b">tempest-ServerRescueNegativeTestJSON-480181232-project-member</nova:user>
Apr 12 09:17:35 user nova-compute[71482]:         <nova:project uuid="1c3cc8ab6ab244b1badb6fea347d64ea">tempest-ServerRescueNegativeTestJSON-480181232</nova:project>
Apr 12 09:17:35 user nova-compute[71482]:       </nova:owner>
Apr 12 09:17:35 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:17:35 user nova-compute[71482]:       <nova:ports>
Apr 12 09:17:35 user nova-compute[71482]:         <nova:port uuid="a0e06b9c-27fc-47a2-a5d1-0da741a09eaa">
Apr 12 09:17:35 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:17:35 user nova-compute[71482]:         </nova:port>
Apr 12 09:17:35 user nova-compute[71482]:       </nova:ports>
Apr 12 09:17:35 user nova-compute[71482]:     </nova:instance>
Apr 12 09:17:35 user nova-compute[71482]:   </metadata>
Apr 12 09:17:35 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:17:35 user nova-compute[71482]:     <system>
Apr 12 09:17:35 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:17:35 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:17:35 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:17:35 user nova-compute[71482]:       <entry name="serial">0fe0c221-d660-4a7e-9fd8-5d9b49c659d0</entry>
Apr 12 09:17:35 user nova-compute[71482]:       <entry name="uuid">0fe0c221-d660-4a7e-9fd8-5d9b49c659d0</entry>
Apr 12 09:17:35 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:17:35 user nova-compute[71482]:     </system>
Apr 12 09:17:35 user nova-compute[71482]:   </sysinfo>
Apr 12 09:17:35 user nova-compute[71482]:   <os>
Apr 12 09:17:35 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:17:35 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:17:35 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:17:35 user nova-compute[71482]:   </os>
Apr 12 09:17:35 user nova-compute[71482]:   <features>
Apr 12 09:17:35 user nova-compute[71482]:     <acpi/>
Apr 12 09:17:35 user nova-compute[71482]:     <apic/>
Apr 12 09:17:35 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:17:35 user nova-compute[71482]:   </features>
Apr 12 09:17:35 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:17:35 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:17:35 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:17:35 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:17:35 user nova-compute[71482]:   </clock>
Apr 12 09:17:35 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:17:35 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:17:35 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:17:35 user nova-compute[71482]:   </cpu>
Apr 12 09:17:35 user nova-compute[71482]:   <devices>
Apr 12 09:17:35 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:17:35 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:17:35 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk"/>
Apr 12 09:17:35 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:17:35 user nova-compute[71482]:     </disk>
Apr 12 09:17:35 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:17:35 user nova-compute[71482]:       <mac address="fa:16:3e:48:07:99"/>
Apr 12 09:17:35 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:35 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:17:35 user nova-compute[71482]:       <target dev="tapa0e06b9c-27"/>
Apr 12 09:17:35 user nova-compute[71482]:     </interface>
Apr 12 09:17:35 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:17:35 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/console.log" append="off"/>
Apr 12 09:17:35 user nova-compute[71482]:     </serial>
Apr 12 09:17:35 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:17:35 user nova-compute[71482]:     <video>
Apr 12 09:17:35 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:35 user nova-compute[71482]:     </video>
Apr 12 09:17:35 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:17:35 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:17:35 user nova-compute[71482]:     </rng>
Apr 12 09:17:35 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:17:35 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:17:35 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:17:35 user nova-compute[71482]:     </memballoon>
Apr 12 09:17:35 user nova-compute[71482]:   </devices>
Apr 12 09:17:35 user nova-compute[71482]: </domain>
Apr 12 09:17:35 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1045691490',display_name='tempest-ServerRescueNegativeTestJSON-server-1045691490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1045691490',id=21,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRFQGCKpi8fjGcdpMDws7TZ+hZpwQGB4rtL60LdXbaRXqJvmTcXhTPGYdQ+Z42mEAB4P05g7T0Z0J2ARvc+I4t9vDocY1CSO+itTj8pMWaDXEEILwFmJvFWolS0ihRs3g==',key_name='tempest-keypair-1774942187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-i1bjiuzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b983634234693ba04a3097c2a129b',uuid=0fe0c221-d660-4a7e-9fd8-5d9b49c659d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:07:99,bridge_name='br-int',has_traffic_filtering=True,id=a0e06b9c-27fc-47a2-a5d1-0da741a09eaa,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e06b9c-27') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG os_vif [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:07:99,bridge_name='br-int',has_traffic_filtering=True,id=a0e06b9c-27fc-47a2-a5d1-0da741a09eaa,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e06b9c-27') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0e06b9c-27, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0e06b9c-27, col_values=(('external_ids', {'iface-id': 'a0e06b9c-27fc-47a2-a5d1-0da741a09eaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:07:99', 'vm-uuid': '0fe0c221-d660-4a7e-9fd8-5d9b49c659d0'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:35 user nova-compute[71482]: INFO os_vif [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:07:99,bridge_name='br-int',has_traffic_filtering=True,id=a0e06b9c-27fc-47a2-a5d1-0da741a09eaa,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e06b9c-27')
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No VIF found with MAC fa:16:3e:48:07:99, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received event network-vif-plugged-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] No waiting events found dispatching network-vif-plugged-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:35 user nova-compute[71482]: WARNING nova.compute.manager [req-29c06657-3dad-4a2c-b36c-579bda51732f req-5a881911-3183-4c7b-aecd-05073d7dcd6d service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received unexpected event network-vif-plugged-3fe5d678-976e-467d-888f-4575a3cc2efe for instance with vm_state building and task_state spawning.
Apr 12 09:17:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updated VIF entry in instance network info cache for port a0e06b9c-27fc-47a2-a5d1-0da741a09eaa. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:17:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating instance_info_cache with network_info: [{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e5fd0ea1-ef00-4928-bc70-5fba78c26d0f req-23858809-c003-43d3-a5f3-e19144eda9fe service nova] Releasing lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received event network-vif-plugged-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] No waiting events found dispatching network-vif-plugged-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:37 user nova-compute[71482]: WARNING nova.compute.manager [req-6dd5491b-443e-4498-a7d8-0da8c3a03d53 req-f02afc5b-59df-4255-b20d-bc507e2736fc service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received unexpected event network-vif-plugged-3fe5d678-976e-467d-888f-4575a3cc2efe for instance with vm_state building and task_state spawning.
Apr 12 09:17:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:38 user nova-compute[71482]: WARNING nova.compute.manager [req-6c2333a9-798f-4e72-998f-6e1a14157a33 req-e43ced56-5d2e-41c6-bb51-9fd92256170d service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state building and task_state spawning.
Apr 12 09:17:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:17:38 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:17:38 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:17:38 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fd32b0-7edc-4b3f-9f09-a14377c05a1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:17:38 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a57a741-a08b-492a-862c-22ecd43b93cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58] added
Apr 12 09:17:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfab59c-8f73-4510-b7d0-c90168f554bf]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1352dd1-6044-476d-b861-3dcca45dcb3c]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwjLxYMF {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwjLxYMF" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a91924-6526-4fee-b950-073d0672c1da]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gwjLxYMF'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[902582dd-7f9e-48ec-9027-b18ef3cd540d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c432b4b-f4c6-415f-bca2-8cdc1b3eb42b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:38 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:38 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d19ce2-f0e1-4a53-ac53-d403aa2a6c3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]
Apr 12 09:17:38 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.
Apr 12 09:17:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71c7960-86b8-4a7e-bc75-b07c66e3bd13]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4cf129-a8cd-4359-a550-0d3164c55e22]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:38 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:38 user nova-compute[71482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:17:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:38 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:38 user nova-compute[71482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:17:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf41fc0-f5ba-4525-934a-185ffe853124]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:17:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291059.2124467, 9691009c-8aca-4347-8e46-c5bdda13aa3d => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] VM Resumed (Lifecycle Event)
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Instance spawned successfully.
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291059.2179203, 9691009c-8aca-4347-8e46-c5bdda13aa3d => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] VM Started (Lifecycle Event)
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Took 8.51 seconds to spawn the instance on the hypervisor.
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.compute.manager [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Took 9.45 seconds to build instance.
Apr 12 09:17:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0c0a7ce7-0e58-4af8-bd22-587a00f0f8af tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.544s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291059.85339, 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] VM Resumed (Lifecycle Event)
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Instance spawned successfully.
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291059.856021, 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] VM Started (Lifecycle Event)
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23961393632656563', 'path': '/dev/sdd'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961393632656563', 'path': '/dev/sdd'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.objects.instance [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'flavor' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:17:39 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:17:39 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:17:39 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:17:39 user nova-compute[71482]:   <serial>7d6b141c-5f82-4aed-b319-8579a78c6c58</serial>
Apr 12 09:17:39 user nova-compute[71482]: </disk>
Apr 12 09:17:39 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:17:40 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:17:40 user nova-compute[71482]: INFO nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Took 7.46 seconds to spawn the instance on the hypervisor.
Apr 12 09:17:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:40 user nova-compute[71482]: INFO nova.compute.manager [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Took 8.60 seconds to build instance.
Apr 12 09:17:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0e5fb7d0-edc2-4ed9-8e0d-1252c5b2084b tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.802s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:40 user nova-compute[71482]: WARNING nova.compute.manager [req-d1e2ccc2-917c-482e-8a34-39eb4d35dfe6 req-9a2aca49-2cc7-4089-8d53-489861c147b6 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state active and task_state None.
Apr 12 09:17:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:17:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:17:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No VIF found with MAC fa:16:3e:9b:4e:53, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:17:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c2b49c43-0282-40c6-94b9-facf5ed800b9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.238s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Stashing vm_state: active {{(pid=71482) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 09:17:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:42 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'pci_requests' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:17:42 user nova-compute[71482]: INFO nova.compute.claims [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Claim successful on node user
Apr 12 09:17:42 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'resources' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:42 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:42 user nova-compute[71482]: INFO nova.compute.resource_tracker [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating resource usage from migration b4e9d3fa-6964-4d5d-862f-023b3af68632
Apr 12 09:17:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:43 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:17:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:17:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.551s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:43 user nova-compute[71482]: INFO nova.compute.manager [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Migrating
Apr 12 09:17:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:43 user nova-compute[71482]: INFO nova.compute.rpcapi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 12 09:17:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:43 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:17:43 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Starting migrate_disk_and_power_off {{(pid=71482) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:44 user nova-compute[71482]: WARNING nova.compute.manager [req-67dfbfb1-1af7-40eb-aa9c-1b9853f1b8fb req-d1bd26f8-7d96-4fe7-9374-375616fc0553 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state resize_migrating.
Apr 12 09:17:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance destroyed successfully.
Apr 12 09:17:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:17:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:9b:4e:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:9b:4e:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_vif [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc64c2a8-53, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:44 user nova-compute[71482]: INFO os_vif [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53')
Apr 12 09:17:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:17:44 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6caf18-9447-44f0-95e1-6b0613d76eff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:17:44 user nova-compute[71482]: No targets found.
Apr 12 09:17:44 user nova-compute[71482]: iSNS:
Apr 12 09:17:44 user nova-compute[71482]: No targets found.
Apr 12 09:17:44 user nova-compute[71482]: STATIC:
Apr 12 09:17:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:17:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:17:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:17:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58
Apr 12 09:17:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:17:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:17:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:17:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:17:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:17:44 user nova-compute[71482]: FIRMWARE:
Apr 12 09:17:44 user nova-compute[71482]: No targets found.
Apr 12 09:17:44 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:17:44 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:17:44 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[331b02a7-2159-4485-9eea-4c7b0938b281]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4d3112-368e-4ecb-834c-600382815f2f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:44 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:44 user nova-compute[71482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:17:44 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:44 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:44 user nova-compute[71482]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:17:44 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c283b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58'): ({'sdd'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Removing single pathed devices sdd {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:17:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de8cc8-19b4-4a3c-89b0-ada4209c95cb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b8354c-1e95-42e4-95cc-4058e86ae901]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flushing IO for device /dev/sdd {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ca8f19-7c37-4cff-b14f-d5a1b4423175]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3a9c9c-5f33-488b-a530-f5bf05964f01]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0989b8bb-15a8-47e9-8056-74d81c2d4868]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c91cb7-2a22-4874-af9d-5092ddc1ee89]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]
Apr 12 09:17:45 user nova-compute[71482]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.
Apr 12 09:17:45 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f261e61-dc65-4661-bf30-881ea762a8a1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== disconnect_volume: return (305ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1_resize/disk /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "cp -r /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1_resize/disk /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk" returned: 0 in 0.228s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1_resize/disk.info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk.info {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "cp -r /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1_resize/disk.info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk.info" returned: 0 in 0.032s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:46 user nova-compute[71482]: WARNING nova.compute.manager [req-78ee6092-3aea-4772-bda5-b2ba77bdb134 req-6506a72e-2459-4b53-ad82-1a68d7ad77e2 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state resize_migrating.
Apr 12 09:17:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Port dc64c2a8-533c-40df-b88e-c059cb9cda89 binding to destination host user is already ACTIVE {{(pid=71482) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 09:17:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:17:47 user nova-compute[71482]: INFO nova.compute.manager [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Unrescuing
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquired lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG os_brick.utils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5471d60-3167-4e77-a96c-29dd5ec1a4dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f4e535-5499-4f8d-a7a3-ca20a12c1d64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4a22d9-1c67-4d4b-b342-f8b92535aec4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca683873-c694-4451-b046-c82ec974a193]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:17:47 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:17:47 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6f23e4-00b0-4084-9874-0781bf14d8c0]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:17:47 user nova-compute[71482]: DEBUG os_brick.utils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updating instance_info_cache with network_info: [{"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.network.neutron [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updating instance_info_cache with network_info: [{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Releasing lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.objects.instance [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'flavor' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-changed-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Refreshing instance network info cache due to event network-changed-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] Acquiring lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] Acquired lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Refreshing network info cache for port dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-unplugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-unplugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:48 user nova-compute[71482]: WARNING nova.compute.manager [req-28eadea8-8bb1-456f-9b2f-1497bc43d08d req-5ddd6ee9-b266-4d8a-b396-0a44eedeecf5 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-unplugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:17:49 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:17:49 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:17:49 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Instance destroyed successfully.
Apr 12 09:17:49 user nova-compute[71482]: DEBUG nova.network.neutron [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updated VIF entry in instance network info cache for port dd53e034-3c1a-4153-b8ba-fc9db5cfea0e. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:17:49 user nova-compute[71482]: DEBUG nova.network.neutron [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updating instance_info_cache with network_info: [{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-aa2d25a6-7e77-4e25-ba23-b5d9d5cb7a1e req-5417784a-bc5e-43ce-b67c-cc7fcace7130 service nova] Releasing lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-changed-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Refreshing instance network info cache due to event network-changed-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] Acquiring lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] Acquired lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG nova.network.neutron [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Refreshing network info cache for port dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:50 user nova-compute[71482]: WARNING nova.compute.manager [req-ce35b225-b45e-4d07-be8a-89bd2c6a94e8 req-860d29ae-ae38-48f4-acfb-7294fa5a3615 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:17:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:17:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:51 user nova-compute[71482]: DEBUG nova.network.neutron [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updated VIF entry in instance network info cache for port dd53e034-3c1a-4153-b8ba-fc9db5cfea0e. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:17:51 user nova-compute[71482]: DEBUG nova.network.neutron [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updating instance_info_cache with network_info: [{"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:17:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afc41bfe-6dc1-406c-bca5-2abf4cdbbcf8 req-18fc6bb8-3bcf-42b0-9600-8491a3059a23 service nova] Releasing lock "refresh_cache-7cec0e09-36ac-43c7-9299-819b65c9da6b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Starting finish_migration {{(pid=71482) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance directory exists: not creating {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 09:17:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Creating image(s)
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Cannot resize image /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Ensure instance console log exists: /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Start _get_guest_xml network_info=[{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:9b:4e:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a05eb4f0-810a-4521-9874-7179662d4e62', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4f211820-161b-4bef-b25d-ced137325da1', 'attached_at': '2023-04-12T09:17:52.000000', 'detached_at': '', 'volume_id': '7d6b141c-5f82-4aed-b319-8579a78c6c58', 'serial': '7d6b141c-5f82-4aed-b319-8579a78c6c58'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:17:52 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:52 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:17:52 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:17:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:17:52 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:17:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:17:52 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[95480442-f8e8-4559-bb2e-f62643649395]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:17:52 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5308512e-0d9c-42a9-b3c9-9321113997f8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58] added
Apr 12 09:17:52 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6674e9-923e-4f07-8180-04024b38f0e5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd2ace2-cd97-453b-a7f7-d9856276f1a8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwjLxYMF {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwjLxYMF" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[59450ef5-8f2d-46ed-b402-ad1606b737b1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gwjLxYMF'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:53 user nova-compute[71482]: WARNING nova.compute.manager [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:53 user nova-compute[71482]: WARNING nova.compute.manager [req-782752da-44df-4fd6-a0df-6fe07eb9e892 req-bfe53cee-c35a-496d-b40f-6d772cc8a90d service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d365860-1fcf-4d88-94b7-04aa80e1c900]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2451e90-7583-4bde-8c49-de183e5df80f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:53 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:53 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[103d52f2-7732-4eb2-b0fe-fc11c89770f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]
Apr 12 09:17:53 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.
Apr 12 09:17:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef51d23f-ce93-429d-8d5e-93ff43108fed]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cd947b-5826-4bd8-bad9-b8b061f6c6b2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:53 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:53 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:17:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:17:53 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:17:53 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:17:53 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb809f01-e64d-49ef-ab08-8929caed3525]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-ac5800f7-ac2b-4b80-bd48-9791081eec90 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 7cec0e09-36ac-43c7-9299-819b65c9da6b due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291073.2559054, 7cec0e09-36ac-43c7-9299-819b65c9da6b => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:53 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] VM Resumed (Lifecycle Event)
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:53 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291073.256393, 7cec0e09-36ac-43c7-9299-819b65c9da6b => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:53 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] VM Started (Lifecycle Event)
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23961393632656563', 'path': '/dev/sdd'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961393632656563', 'path': '/dev/sdd'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:9b:4e:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:9b:4e:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:17:54 user nova-compute[71482]:   <uuid>4f211820-161b-4bef-b25d-ced137325da1</uuid>
Apr 12 09:17:54 user nova-compute[71482]:   <name>instance-00000003</name>
Apr 12 09:17:54 user nova-compute[71482]:   <memory>196608</memory>
Apr 12 09:17:54 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:17:54 user nova-compute[71482]:   <metadata>
Apr 12 09:17:54 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:17:54 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:17:54 user nova-compute[71482]:       <nova:name>tempest-ServerActionsTestJSON-server-1204181922</nova:name>
Apr 12 09:17:54 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:17:52</nova:creationTime>
Apr 12 09:17:54 user nova-compute[71482]:       <nova:flavor name="m1.micro">
Apr 12 09:17:54 user nova-compute[71482]:         <nova:memory>192</nova:memory>
Apr 12 09:17:54 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:17:54 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:17:54 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:17:54 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:17:54 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:17:54 user nova-compute[71482]:       <nova:owner>
Apr 12 09:17:54 user nova-compute[71482]:         <nova:user uuid="375db5b9a80244d3878822049230ba47">tempest-ServerActionsTestJSON-1142062861-project-member</nova:user>
Apr 12 09:17:54 user nova-compute[71482]:         <nova:project uuid="20b8c89c46bb460f9f94be9426a22bb8">tempest-ServerActionsTestJSON-1142062861</nova:project>
Apr 12 09:17:54 user nova-compute[71482]:       </nova:owner>
Apr 12 09:17:54 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:17:54 user nova-compute[71482]:       <nova:ports>
Apr 12 09:17:54 user nova-compute[71482]:         <nova:port uuid="dc64c2a8-533c-40df-b88e-c059cb9cda89">
Apr 12 09:17:54 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 09:17:54 user nova-compute[71482]:         </nova:port>
Apr 12 09:17:54 user nova-compute[71482]:       </nova:ports>
Apr 12 09:17:54 user nova-compute[71482]:     </nova:instance>
Apr 12 09:17:54 user nova-compute[71482]:   </metadata>
Apr 12 09:17:54 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:17:54 user nova-compute[71482]:     <system>
Apr 12 09:17:54 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:17:54 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:17:54 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:17:54 user nova-compute[71482]:       <entry name="serial">4f211820-161b-4bef-b25d-ced137325da1</entry>
Apr 12 09:17:54 user nova-compute[71482]:       <entry name="uuid">4f211820-161b-4bef-b25d-ced137325da1</entry>
Apr 12 09:17:54 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:17:54 user nova-compute[71482]:     </system>
Apr 12 09:17:54 user nova-compute[71482]:   </sysinfo>
Apr 12 09:17:54 user nova-compute[71482]:   <os>
Apr 12 09:17:54 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:17:54 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:17:54 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:17:54 user nova-compute[71482]:   </os>
Apr 12 09:17:54 user nova-compute[71482]:   <features>
Apr 12 09:17:54 user nova-compute[71482]:     <acpi/>
Apr 12 09:17:54 user nova-compute[71482]:     <apic/>
Apr 12 09:17:54 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:17:54 user nova-compute[71482]:   </features>
Apr 12 09:17:54 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:17:54 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:17:54 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:17:54 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:17:54 user nova-compute[71482]:   </clock>
Apr 12 09:17:54 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:17:54 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:17:54 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:17:54 user nova-compute[71482]:   </cpu>
Apr 12 09:17:54 user nova-compute[71482]:   <devices>
Apr 12 09:17:54 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:17:54 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:17:54 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk"/>
Apr 12 09:17:54 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:17:54 user nova-compute[71482]:     </disk>
Apr 12 09:17:54 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:17:54 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:17:54 user nova-compute[71482]:       <source dev="/dev/sdd"/>
Apr 12 09:17:54 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:17:54 user nova-compute[71482]:       <serial>7d6b141c-5f82-4aed-b319-8579a78c6c58</serial>
Apr 12 09:17:54 user nova-compute[71482]:     </disk>
Apr 12 09:17:54 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:17:54 user nova-compute[71482]:       <mac address="fa:16:3e:9b:4e:53"/>
Apr 12 09:17:54 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:54 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:17:54 user nova-compute[71482]:       <target dev="tapdc64c2a8-53"/>
Apr 12 09:17:54 user nova-compute[71482]:     </interface>
Apr 12 09:17:54 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:17:54 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/console.log" append="off"/>
Apr 12 09:17:54 user nova-compute[71482]:     </serial>
Apr 12 09:17:54 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:17:54 user nova-compute[71482]:     <video>
Apr 12 09:17:54 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:17:54 user nova-compute[71482]:     </video>
Apr 12 09:17:54 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:17:54 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:17:54 user nova-compute[71482]:     </rng>
Apr 12 09:17:54 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:17:54 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:17:54 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:17:54 user nova-compute[71482]:     </memballoon>
Apr 12 09:17:54 user nova-compute[71482]:   </devices>
Apr 12 09:17:54 user nova-compute[71482]: </domain>
Apr 12 09:17:54 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:9b:4e:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:9b:4e:53"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG os_vif [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc64c2a8-53, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc64c2a8-53, col_values=(('external_ids', {'iface-id': 'dc64c2a8-533c-40df-b88e-c059cb9cda89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:4e:53', 'vm-uuid': '4f211820-161b-4bef-b25d-ced137325da1'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:54 user nova-compute[71482]: INFO os_vif [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53')
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:17:54 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No VIF found with MAC fa:16:3e:9b:4e:53, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG nova.compute.manager [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:55 user nova-compute[71482]: DEBUG nova.compute.manager [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:55 user nova-compute[71482]: WARNING nova.compute.manager [req-6ecc41c6-bd32-494b-8089-20c48b079bdc req-be8fb325-6b67-4210-a06c-f5f50e8adaa4 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state resize_finish.
Apr 12 09:17:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:56 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 4f211820-161b-4bef-b25d-ced137325da1 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291077.9632459, 4f211820-161b-4bef-b25d-ced137325da1 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:57 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Resumed (Lifecycle Event)
Apr 12 09:17:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG nova.compute.manager [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG nova.compute.manager [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:17:58 user nova-compute[71482]: WARNING nova.compute.manager [req-81d754ce-871a-4744-8b13-85b6359230b5 req-396ae167-c7ba-4040-9e4f-7e0381f722ae service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state resize_finish.
Apr 12 09:17:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance running successfully.
Apr 12 09:17:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Failed to set time: agent not configured {{(pid=71482) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2a4028a3-e63b-4549-a063-238cc2b0a76c tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] finish_migration finished successfully. {{(pid=71482) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 09:17:58 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 09:17:58 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291077.9739861, 4f211820-161b-4bef-b25d-ced137325da1 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:17:58 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Started (Lifecycle Event)
Apr 12 09:17:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:17:58 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:17:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:00 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:18:00 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=26.205642700195312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Applying migration context for instance 4f211820-161b-4bef-b25d-ced137325da1 as it has an incoming, in-progress migration b4e9d3fa-6964-4d5d-862f-023b3af68632. Migration status is finished {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 09:18:00 user nova-compute[71482]: INFO nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating resource usage from migration b4e9d3fa-6964-4d5d-862f-023b3af68632
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance f683bc12-8fca-47de-b28e-a0070e77b387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e442604c-86f4-45e1-9407-1764133852ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 25232386-f51a-434b-9280-c4dd30b55f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Migration b4e9d3fa-6964-4d5d-862f-023b3af68632 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:18:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.641s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:18:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:18:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:18:20 user nova-compute[71482]: INFO nova.compute.manager [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Detaching volume ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:18:20 user nova-compute[71482]: INFO nova.virt.block_device [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Attempting to driver detach volume ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 from mountpoint /dev/vdb
Apr 12 09:18:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Attempting to detach device vdb from instance 7cec0e09-36ac-43c7-9299-819b65c9da6b from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:18:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:18:20 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:18:20 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:18:20 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:18:20 user nova-compute[71482]:   <serial>ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927</serial>
Apr 12 09:18:20 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:18:20 user nova-compute[71482]: </disk>
Apr 12 09:18:20 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:18:20 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Successfully detached device vdb from instance 7cec0e09-36ac-43c7-9299-819b65c9da6b from the persistent domain config.
Apr 12 09:18:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7cec0e09-36ac-43c7-9299-819b65c9da6b from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:18:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:18:20 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:18:20 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:18:20 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:18:20 user nova-compute[71482]:   <serial>ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927</serial>
Apr 12 09:18:20 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:18:20 user nova-compute[71482]: </disk>
Apr 12 09:18:20 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681291101.142132, 7cec0e09-36ac-43c7-9299-819b65c9da6b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:18:21 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Successfully detached device vdb from instance 7cec0e09-36ac-43c7-9299-819b65c9da6b from the live domain config.
Apr 12 09:18:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ucgkSDoq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:18:21 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b7e29-43ac-45e2-ac25-1e6b1becf823]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:18:21 user nova-compute[71482]: No targets found.
Apr 12 09:18:21 user nova-compute[71482]: iSNS:
Apr 12 09:18:21 user nova-compute[71482]: No targets found.
Apr 12 09:18:21 user nova-compute[71482]: STATIC:
Apr 12 09:18:21 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927
Apr 12 09:18:21 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:18:21 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:18:21 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58
Apr 12 09:18:21 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:18:21 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:18:21 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:18:21 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:18:21 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:18:21 user nova-compute[71482]: FIRMWARE:
Apr 12 09:18:21 user nova-compute[71482]: No targets found.
Apr 12 09:18:21 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:18:21 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:18:21 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ba55ac-8a79-4795-9e7e-6e407fc2f33e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c003835d-9244-4db6-88b3-24590761dae0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:18:21 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:18:21 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:18:21 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:18:21 user nova-compute[71482]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 (non-flash)
Apr 12 09:18:21 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:18:21 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9349cd4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5e1e1b-2cf2-4d70-9bc9-31179043a220]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfa6992-5816-4c48-bbb2-69c34b061e52]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d80b6ae-429a-4a54-92e4-8d30242f6a99]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ed8788-8a4a-417b-88dd-2f355f67d25c]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19ced87-15a4-407b-b12c-2142255c39cc]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d729827-f623-4cfd-9105-796902fec9e0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927, portal: 172.16.0.220,3260]
Apr 12 09:18:21 user nova-compute[71482]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927, portal: 172.16.0.220,3260] successful.
Apr 12 09:18:21 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac9fc5e0-8242-4187-8fa6-6fe6f4f8a927 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e552e2-a864-4874-bee6-9fa4ba8f6023]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] <== disconnect_volume: return (323ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:18:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:18:22 user nova-compute[71482]: DEBUG nova.objects.instance [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'flavor' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:18:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f814fc-8928-474f-85ce-c76d3c5d7a49 tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.716s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:18:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:18:28 user nova-compute[71482]: INFO nova.compute.manager [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Terminating instance
Apr 12 09:18:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-unplugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-unplugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:18:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-9d791fec-89a1-4eb6-9d31-c84d094e3d57 req-b535d45c-6fc9-46c0-898c-23b10a9ec3b7 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-unplugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Instance destroyed successfully.
Apr 12 09:18:29 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'resources' on Instance uuid f683bc12-8fca-47de-b28e-a0070e77b387 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-9128142',display_name='tempest-AttachVolumeTestJSON-server-9128142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-9128142',id=5,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1Kf/cduySUqwOCuXX5Q5nAyFsmIVaM/jyEcRC7ftpIWhgUmLjAtq2LJzAXO7r1uKdmNPIyp3/F8uRap+mHA2E5cbHI1gzxUGZRh9nH78IeI+mJKDSktL65HKGOG1ZY9w==',key_name='tempest-keypair-2058620837',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-hp2b9h01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=f683bc12-8fca-47de-b28e-a0070e77b387,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "address": "fa:16:3e:f3:e5:20", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape957a8ce-db", "ovs_interfaceid": "e957a8ce-db60-4c11-8fcf-6b88d77e8e4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG os_vif [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape957a8ce-db, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:18:29 user nova-compute[71482]: INFO os_vif [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:e5:20,bridge_name='br-int',has_traffic_filtering=True,id=e957a8ce-db60-4c11-8fcf-6b88d77e8e4f,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape957a8ce-db')
Apr 12 09:18:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Deleting instance files /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387_del
Apr 12 09:18:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Deletion of /opt/stack/data/nova/instances/f683bc12-8fca-47de-b28e-a0070e77b387_del complete
Apr 12 09:18:29 user nova-compute[71482]: INFO nova.compute.manager [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 09:18:29 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:18:29 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:18:30 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Took 0.74 seconds to deallocate network for instance.
Apr 12 09:18:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-5314bad1-4930-44f4-99ff-30502595daa4 req-fae4e1b2-042d-4326-b7f3-5e1d9be425a6 service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-deleted-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:18:30 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Deleted allocations for instance f683bc12-8fca-47de-b28e-a0070e77b387
Apr 12 09:18:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b4a61290-07f3-415f-99e4-13548cf26c61 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "f683bc12-8fca-47de-b28e-a0070e77b387" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] Acquiring lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] Lock "f683bc12-8fca-47de-b28e-a0070e77b387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:18:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] No waiting events found dispatching network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:18:30 user nova-compute[71482]: WARNING nova.compute.manager [req-686422b8-65d4-4590-97ba-124dd939bfdd req-08cddaf1-5138-4418-9a81-3d6f9f80921c service nova] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Received unexpected event network-vif-plugged-e957a8ce-db60-4c11-8fcf-6b88d77e8e4f for instance with vm_state deleted and task_state None.
Apr 12 09:18:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:44 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291109.3520005, f683bc12-8fca-47de-b28e-a0070e77b387 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:18:44 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] VM Stopped (Lifecycle Event)
Apr 12 09:18:44 user nova-compute[71482]: DEBUG nova.compute.manager [None req-73707958-5659-498e-8659-f61c7fae5c95 None None] [instance: f683bc12-8fca-47de-b28e-a0070e77b387] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:18:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:18:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:18:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:18:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updating instance_info_cache with network_info: [{"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:18:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:18:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:00 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:00 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7848MB free_disk=26.22332000732422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Applying migration context for instance 4f211820-161b-4bef-b25d-ced137325da1 as it has an incoming, in-progress migration b4e9d3fa-6964-4d5d-862f-023b3af68632. Migration status is finished {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 09:19:00 user nova-compute[71482]: INFO nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating resource usage from migration b4e9d3fa-6964-4d5d-862f-023b3af68632
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 7cec0e09-36ac-43c7-9299-819b65c9da6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e442604c-86f4-45e1-9407-1764133852ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 25232386-f51a-434b-9280-c4dd30b55f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Migration b4e9d3fa-6964-4d5d-862f-023b3af68632 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:19:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:19:01 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:19:01 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:19:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:19:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:02 user nova-compute[71482]: INFO nova.compute.manager [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] instance snapshotting
Apr 12 09:19:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Beginning live snapshot process
Apr 12 09:19:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json -f qcow2 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json -f qcow2 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphy04bhbn/4ab6c0c3dbb243e28e95f4492f0d258e.delta 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphy04bhbn/4ab6c0c3dbb243e28e95f4492f0d258e.delta 1073741824" returned: 0 in 0.050s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 12 09:19:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:19:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71482) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 12 09:19:04 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 12 09:19:04 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:19:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphy04bhbn/4ab6c0c3dbb243e28e95f4492f0d258e.delta /opt/stack/data/nova/instances/snapshots/tmphy04bhbn/4ab6c0c3dbb243e28e95f4492f0d258e {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphy04bhbn/4ab6c0c3dbb243e28e95f4492f0d258e.delta /opt/stack/data/nova/instances/snapshots/tmphy04bhbn/4ab6c0c3dbb243e28e95f4492f0d258e" returned: 0 in 0.252s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:04 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Snapshot extracted, beginning image upload
Apr 12 09:19:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:06 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Snapshot image upload complete
Apr 12 09:19:06 user nova-compute[71482]: INFO nova.compute.manager [None req-9e279d74-bc69-4699-999f-f9ba91e5b507 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Took 4.46 seconds to snapshot the instance on the hypervisor.
Apr 12 09:19:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:13 user nova-compute[71482]: INFO nova.compute.manager [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Terminating instance
Apr 12 09:19:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-unplugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-unplugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-57743e3c-3165-4b99-b983-3c5e24bcf661 req-c78f5b8b-b5df-4430-9712-bb426ec6abbd service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-unplugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:19:14 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Instance destroyed successfully.
Apr 12 09:19:14 user nova-compute[71482]: DEBUG nova.objects.instance [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lazy-loading 'resources' on Instance uuid 7cec0e09-36ac-43c7-9299-819b65c9da6b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:12:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-430343469',display_name='tempest-ServerStableDeviceRescueTest-server-430343469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-430343469',id=13,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4vJjgMKDKaWr0Dy8W2bVCeXaYOmTVfeTv9/3UEUmN+6itpsXzbaWpnFjPJUdjwFtuYYeFZdZPUeplH0aO/nZtpvGeDHXHuXoefAJJIu7CBy1InWrkCMQqKrIm1eU6g5A==',key_name='tempest-keypair-681767073',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:16:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28ede6e9cdbc4b71a1affaddfd1ad9a3',ramdisk_id='',reservation_id='r-7c212l7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1869366097',owner_user_name='tempest-ServerStableDeviceRescueTest-1869366097-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:17:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9afc908ad0e4ba9ab74006817cc0895',uuid=7cec0e09-36ac-43c7-9299-819b65c9da6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Converting VIF {"id": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "address": "fa:16:3e:5d:48:ac", "network": {"id": "a113fe76-9546-4c8d-9c26-762c017f777f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2108614368-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28ede6e9cdbc4b71a1affaddfd1ad9a3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd53e034-3c", "ovs_interfaceid": "dd53e034-3c1a-4153-b8ba-fc9db5cfea0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:48:ac,bridge_name='br-int',has_traffic_filtering=True,id=dd53e034-3c1a-4153-b8ba-fc9db5cfea0e,network=Network(a113fe76-9546-4c8d-9c26-762c017f777f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd53e034-3c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG os_vif [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:48:ac,bridge_name='br-int',has_traffic_filtering=True,id=dd53e034-3c1a-4153-b8ba-fc9db5cfea0e,network=Network(a113fe76-9546-4c8d-9c26-762c017f777f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd53e034-3c') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd53e034-3c, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:19:14 user nova-compute[71482]: INFO os_vif [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:48:ac,bridge_name='br-int',has_traffic_filtering=True,id=dd53e034-3c1a-4153-b8ba-fc9db5cfea0e,network=Network(a113fe76-9546-4c8d-9c26-762c017f777f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd53e034-3c')
Apr 12 09:19:14 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Deleting instance files /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b_del
Apr 12 09:19:14 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Deletion of /opt/stack/data/nova/instances/7cec0e09-36ac-43c7-9299-819b65c9da6b_del complete
Apr 12 09:19:14 user nova-compute[71482]: INFO nova.compute.manager [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 09:19:14 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:14 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Took 0.70 seconds to deallocate network for instance.
Apr 12 09:19:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:15 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:19:15 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:19:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:15 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Deleted allocations for instance 7cec0e09-36ac-43c7-9299-819b65c9da6b
Apr 12 09:19:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-5c254ba3-ada4-4dbb-8735-5f401f631d4e tempest-ServerStableDeviceRescueTest-1869366097 tempest-ServerStableDeviceRescueTest-1869366097-project-member] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.095s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] Acquiring lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] Lock "7cec0e09-36ac-43c7-9299-819b65c9da6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] No waiting events found dispatching network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:15 user nova-compute[71482]: WARNING nova.compute.manager [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received unexpected event network-vif-plugged-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e for instance with vm_state deleted and task_state None.
Apr 12 09:19:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-b2bc63c1-7a54-4633-b1e1-70163a8b0e9a req-0671ea17-cf4d-4e81-9a11-0459e913ac7e service nova] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Received event network-vif-deleted-dd53e034-3c1a-4153-b8ba-fc9db5cfea0e {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-changed-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Refreshing instance network info cache due to event network-changed-1cf7a879-f705-467c-af44-2b2d40216cef. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:19:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] Acquiring lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] Acquired lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:17 user nova-compute[71482]: DEBUG nova.network.neutron [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Refreshing network info cache for port 1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:19:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updated VIF entry in instance network info cache for port 1cf7a879-f705-467c-af44-2b2d40216cef. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:19:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating instance_info_cache with network_info: [{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-630d3813-6a63-49b7-8854-7f39354ca533 req-17f92356-5481-488a-9aa9-cc1841183c50 service nova] Releasing lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:19 user nova-compute[71482]: INFO nova.compute.manager [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Shelving
Apr 12 09:19:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-unplugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] No waiting events found dispatching network-vif-unplugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:20 user nova-compute[71482]: WARNING nova.compute.manager [req-505d5546-c935-40ce-bd5b-f49afe8e0cb5 req-def05dc0-9de9-4f36-b620-fcc5c895dfdd service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received unexpected event network-vif-unplugged-1cf7a879-f705-467c-af44-2b2d40216cef for instance with vm_state active and task_state shelving.
Apr 12 09:19:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received event network-changed-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Refreshing instance network info cache due to event network-changed-3fe5d678-976e-467d-888f-4575a3cc2efe. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] Acquiring lock "refresh_cache-9691009c-8aca-4347-8e46-c5bdda13aa3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] Acquired lock "refresh_cache-9691009c-8aca-4347-8e46-c5bdda13aa3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG nova.network.neutron [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Refreshing network info cache for port 3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:20 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance destroyed successfully.
Apr 12 09:19:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:20 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Beginning cold snapshot process
Apr 12 09:19:21 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk /opt/stack/data/nova/instances/snapshots/tmp7c2140p8/57ffe3e4382c48cc98035b89a8c14227 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk /opt/stack/data/nova/instances/snapshots/tmp7c2140p8/57ffe3e4382c48cc98035b89a8c14227" returned: 0 in 0.217s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:21 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Snapshot extracted, beginning image upload
Apr 12 09:19:21 user nova-compute[71482]: DEBUG nova.network.neutron [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Updated VIF entry in instance network info cache for port 3fe5d678-976e-467d-888f-4575a3cc2efe. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG nova.network.neutron [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Updating instance_info_cache with network_info: [{"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f6f1365a-cc9c-4ecd-831d-17ac1bb4d575 req-996e4228-dddb-4683-b3c8-fc38e373be8a service nova] Releasing lock "refresh_cache-9691009c-8aca-4347-8e46-c5bdda13aa3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-changed-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Refreshing instance network info cache due to event network-changed-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] Acquiring lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] Acquired lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Refreshing network info cache for port a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'flavor' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.objects.instance [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'flavor' on Instance uuid 9691009c-8aca-4347-8e46-c5bdda13aa3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:22 user nova-compute[71482]: INFO nova.compute.manager [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Attaching volume d1961f4e-4a3f-46cc-95a2-6177a29efeb2 to /dev/vdb
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.utils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[821c6c22-c4fb-496a-b9b8-7a71596b5759]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2342bac6-910e-4835-96be-f85ab3a715f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updated VIF entry in instance network info cache for port a0e06b9c-27fc-47a2-a5d1-0da741a09eaa. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating instance_info_cache with network_info: [{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1087c2-3a68-4a50-aa6b-968487a38a55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c6a1cc-6fb1-4a8d-864c-c68e33542fef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ee142dd9-e0df-408a-8196-2bf6bc5b9579 req-5cba9b7e-833e-4ae3-b0e2-0b83c7525ab2 service nova] Releasing lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:22 user nova-compute[71482]: INFO nova.compute.manager [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Attaching volume 85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 to /dev/vdb
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:19:22 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[153aa077-fac3-406e-9d44-be7677c94006]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.utils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating existing volume attachment record: 04d2e008-383d-4517-8128-6c1955756298 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] No waiting events found dispatching network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:22 user nova-compute[71482]: WARNING nova.compute.manager [req-43703367-cd1c-466e-95f6-a5cb3a839765 req-6f5064ae-ff48-4b60-8b71-aa2ce0b0a7f5 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received unexpected event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.utils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38071b0-db06-440b-9bc7-9896d88227c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21985f8d-8d97-434a-b415-e8d6e47f2f80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[de47a246-a123-4d31-b9be-1982c724b049]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec41064d-0ea2-4598-ba7d-05aa060a23e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:19:22 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:19:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6c46c0-d638-441d-a624-90a8c48188a3]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG os_brick.utils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:19:22 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Updating existing volume attachment record: d290181e-e0a3-43e8-8b7b-93175543cc9d {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:19:23 user nova-compute[71482]: INFO nova.compute.claims [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Claim successful on node user
Apr 12 09:19:23 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Snapshot image upload complete
Apr 12 09:19:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:23 user nova-compute[71482]: INFO nova.compute.manager [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Shelve offloading
Apr 12 09:19:23 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance destroyed successfully.
Apr 12 09:19:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquired lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.network.neutron [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:19:24 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:19:24 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Creating image(s)
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "/opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "/opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "/opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.policy [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a3731bf575c44d89211709cb07060b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e6ce78ce3d4eb5b4bbb307665c3670', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.network.neutron [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating instance_info_cache with network_info: [{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Releasing lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk 1073741824" returned: 0 in 0.047s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Cannot resize image /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.objects.instance [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'migration_context' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Ensure instance console log exists: /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:25 user nova-compute[71482]: DEBUG nova.network.neutron [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Successfully created port: 49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:19:26 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance destroyed successfully.
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.objects.instance [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'resources' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325803830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325803830',id=19,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4JkdmcZevwkBRIvOxZXR/GY5jcnavNiZ74hKGbOyliYHO5bVun8yU8w+4IBWoQC5ayotvjMWHRPPGubYFeG7cJoQLiULRqOwjpOnp0kPQmpgv3dBxk2vLFWpUFCoUImw==',key_name='tempest-keypair-501602451',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-ngwjnp8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member',shelved_at='2023-04-12T09:19:23.655453',shelved_host='user',shelved_image_id='62564285-e4f9-4626-a61e-40b78fa203dd'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=25232386-f51a-434b-9280-c4dd30b55f3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG os_vif [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cf7a879-f7, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-changed-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Refreshing instance network info cache due to event network-changed-1cf7a879-f705-467c-af44-2b2d40216cef. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] Acquiring lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] Acquired lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.network.neutron [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Refreshing network info cache for port 1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:19:26 user nova-compute[71482]: INFO os_vif [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7')
Apr 12 09:19:26 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Deleting instance files /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d_del
Apr 12 09:19:26 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Deletion of /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d_del complete
Apr 12 09:19:26 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Deleted allocations for instance 25232386-f51a-434b-9280-c4dd30b55f3d
Apr 12 09:19:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.objects.instance [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'numa_topology' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:19:26 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.neutron [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updated VIF entry in instance network info cache for port 1cf7a879-f705-467c-af44-2b2d40216cef. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.neutron [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating instance_info_cache with network_info: [{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0ad4b056-7b8e-4773-a3e0-1a74a48440b1 req-c8e717bf-ce35-482a-b89d-505b949ea11d service nova] Releasing lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-117e3215-2a60-49e3-9b74-30da2b689bf8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.106s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Successfully updated port: 49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "refresh_cache-73c2cdd1-9214-4678-91a0-40fdb74403a2" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquired lock "refresh_cache-73c2cdd1-9214-4678-91a0-40fdb74403a2" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlqBRPem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:19:27 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:19:27 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:19:27 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlRDhqQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:19:27 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eb267c-8b9b-44ca-80a0-38b6b36febf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:19:27 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16507c8-4cb5-45f5-a5a7-7b607c305883]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86] added
Apr 12 09:19:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eca36d0-8e76-4a21-83d7-dcaf05f306a4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeed5c24-bf4f-479a-9718-cbc09f83d6f1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlqBRPem {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dlqBRPem" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f54e335-1903-4421-9ee7-615c2cae14af]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dlqBRPem'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f00c283-3a9e-41c1-8163-362340a0ee54]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e4aa29-57f4-4e83-95aa-29062c030723]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:27 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:27 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c6aae-535c-40ca-b8cb-cf066947450e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86, portal: 172.16.0.220,3260]
Apr 12 09:19:27 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86, portal: 172.16.0.220,3260] successful.
Apr 12 09:19:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4b2c35-bbc1-44cb-ba72-ddd209877afc]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Updating instance_info_cache with network_info: [{"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de5cef7-ccd7-4286-9224-d5fb2f3ad2bf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:27 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:27 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:27 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:27 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Releasing lock "refresh_cache-73c2cdd1-9214-4678-91a0-40fdb74403a2" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Instance network_info: |[{"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Start _get_guest_xml network_info=[{"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:19:27 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:27 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1998611823',display_name='tempest-AttachVolumeTestJSON-server-1998611823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1998611823',id=22,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnIl9SCgl+gRiGEuXiMy4XMrc+rm4KKN6tg61KVSaw3G+aWg0i33luIdnCph1+ecByAmzSyxMPbfHh84em5kfq5+K4QbOBA63ZAz57V7w3I+7WSQCtggno/5IECnki4VA==',key_name='tempest-keypair-1500886200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-bljmq1uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:19:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=73c2cdd1-9214-4678-91a0-40fdb74403a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6c:59,bridge_name='br-int',has_traffic_filtering=True,id=49c0392a-a4e7-4b73-af28-79c87a052cd8,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c0392a-a4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.objects.instance [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'pci_devices' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca121417-9579-4ff1-a3a0-6586ed1c9179]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlqBRPem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:19:27 user nova-compute[71482]:   <uuid>73c2cdd1-9214-4678-91a0-40fdb74403a2</uuid>
Apr 12 09:19:27 user nova-compute[71482]:   <name>instance-00000016</name>
Apr 12 09:19:27 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:19:27 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:19:27 user nova-compute[71482]:   <metadata>
Apr 12 09:19:27 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:19:27 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:19:27 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeTestJSON-server-1998611823</nova:name>
Apr 12 09:19:27 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:19:27</nova:creationTime>
Apr 12 09:19:27 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:19:27 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:19:27 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:19:27 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:19:27 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:19:27 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:19:27 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:19:27 user nova-compute[71482]:       <nova:owner>
Apr 12 09:19:27 user nova-compute[71482]:         <nova:user uuid="2a3731bf575c44d89211709cb07060b7">tempest-AttachVolumeTestJSON-1252670961-project-member</nova:user>
Apr 12 09:19:27 user nova-compute[71482]:         <nova:project uuid="23e6ce78ce3d4eb5b4bbb307665c3670">tempest-AttachVolumeTestJSON-1252670961</nova:project>
Apr 12 09:19:27 user nova-compute[71482]:       </nova:owner>
Apr 12 09:19:27 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:19:27 user nova-compute[71482]:       <nova:ports>
Apr 12 09:19:27 user nova-compute[71482]:         <nova:port uuid="49c0392a-a4e7-4b73-af28-79c87a052cd8">
Apr 12 09:19:27 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 09:19:27 user nova-compute[71482]:         </nova:port>
Apr 12 09:19:27 user nova-compute[71482]:       </nova:ports>
Apr 12 09:19:27 user nova-compute[71482]:     </nova:instance>
Apr 12 09:19:27 user nova-compute[71482]:   </metadata>
Apr 12 09:19:27 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:19:27 user nova-compute[71482]:     <system>
Apr 12 09:19:27 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:19:27 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:19:27 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:19:27 user nova-compute[71482]:       <entry name="serial">73c2cdd1-9214-4678-91a0-40fdb74403a2</entry>
Apr 12 09:19:27 user nova-compute[71482]:       <entry name="uuid">73c2cdd1-9214-4678-91a0-40fdb74403a2</entry>
Apr 12 09:19:27 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:19:27 user nova-compute[71482]:     </system>
Apr 12 09:19:27 user nova-compute[71482]:   </sysinfo>
Apr 12 09:19:27 user nova-compute[71482]:   <os>
Apr 12 09:19:27 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:19:27 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:19:27 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:19:27 user nova-compute[71482]:   </os>
Apr 12 09:19:27 user nova-compute[71482]:   <features>
Apr 12 09:19:27 user nova-compute[71482]:     <acpi/>
Apr 12 09:19:27 user nova-compute[71482]:     <apic/>
Apr 12 09:19:27 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:19:27 user nova-compute[71482]:   </features>
Apr 12 09:19:27 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:19:27 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:19:27 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:19:27 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:19:27 user nova-compute[71482]:   </clock>
Apr 12 09:19:27 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:19:27 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:19:27 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:19:27 user nova-compute[71482]:   </cpu>
Apr 12 09:19:27 user nova-compute[71482]:   <devices>
Apr 12 09:19:27 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:19:27 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:19:27 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk"/>
Apr 12 09:19:27 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:19:27 user nova-compute[71482]:     </disk>
Apr 12 09:19:27 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:19:27 user nova-compute[71482]:       <mac address="fa:16:3e:d6:6c:59"/>
Apr 12 09:19:27 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:19:27 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:19:27 user nova-compute[71482]:       <target dev="tap49c0392a-a4"/>
Apr 12 09:19:27 user nova-compute[71482]:     </interface>
Apr 12 09:19:27 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:19:27 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/console.log" append="off"/>
Apr 12 09:19:27 user nova-compute[71482]:     </serial>
Apr 12 09:19:27 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:19:27 user nova-compute[71482]:     <video>
Apr 12 09:19:27 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:19:27 user nova-compute[71482]:     </video>
Apr 12 09:19:27 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:19:27 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:19:27 user nova-compute[71482]:     </rng>
Apr 12 09:19:27 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:19:27 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:19:27 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:19:27 user nova-compute[71482]:     </memballoon>
Apr 12 09:19:27 user nova-compute[71482]:   </devices>
Apr 12 09:19:27 user nova-compute[71482]: </domain>
Apr 12 09:19:27 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1998611823',display_name='tempest-AttachVolumeTestJSON-server-1998611823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1998611823',id=22,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnIl9SCgl+gRiGEuXiMy4XMrc+rm4KKN6tg61KVSaw3G+aWg0i33luIdnCph1+ecByAmzSyxMPbfHh84em5kfq5+K4QbOBA63ZAz57V7w3I+7WSQCtggno/5IECnki4VA==',key_name='tempest-keypair-1500886200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-bljmq1uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:19:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=73c2cdd1-9214-4678-91a0-40fdb74403a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6c:59,bridge_name='br-int',has_traffic_filtering=True,id=49c0392a-a4e7-4b73-af28-79c87a052cd8,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c0392a-a4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG os_vif [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6c:59,bridge_name='br-int',has_traffic_filtering=True,id=49c0392a-a4e7-4b73-af28-79c87a052cd8,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c0392a-a4') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49c0392a-a4, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49c0392a-a4, col_values=(('external_ids', {'iface-id': '49c0392a-a4e7-4b73-af28-79c87a052cd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:6c:59', 'vm-uuid': '73c2cdd1-9214-4678-91a0-40fdb74403a2'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:27 user nova-compute[71482]: INFO os_vif [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6c:59,bridge_name='br-int',has_traffic_filtering=True,id=49c0392a-a4e7-4b73-af28-79c87a052cd8,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c0392a-a4')
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:19:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No VIF found with MAC fa:16:3e:d6:6c:59, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received event network-changed-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Refreshing instance network info cache due to event network-changed-49c0392a-a4e7-4b73-af28-79c87a052cd8. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] Acquiring lock "refresh_cache-73c2cdd1-9214-4678-91a0-40fdb74403a2" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] Acquired lock "refresh_cache-73c2cdd1-9214-4678-91a0-40fdb74403a2" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG nova.network.neutron [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Refreshing network info cache for port 49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG nova.network.neutron [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Updated VIF entry in instance network info cache for port 49c0392a-a4e7-4b73-af28-79c87a052cd8. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG nova.network.neutron [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Updating instance_info_cache with network_info: [{"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-537fb76a-f54c-41d4-ab89-eb27b87b3adc req-d8c594df-7de8-4d56-8f29-15dbde0f1360 service nova] Releasing lock "refresh_cache-73c2cdd1-9214-4678-91a0-40fdb74403a2" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23239313731643634', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239313731643634', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.341s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:19:28 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:19:28 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG nova.objects.instance [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'flavor' on Instance uuid 9691009c-8aca-4347-8e46-c5bdda13aa3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7a3cb1-3021-4027-a40b-b8f1cbb8e15b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:19:28 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:19:28 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:19:28 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:19:28 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:19:28 user nova-compute[71482]:   <serial>85f0b6fa-1590-4f2f-a26b-e7a3e236ea86</serial>
Apr 12 09:19:28 user nova-compute[71482]: </disk>
Apr 12 09:19:28 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[49478943-1225-45cc-8783-7e8fa92a6adb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2] added
Apr 12 09:19:28 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50cfd5a-d596-418b-ae64-72e4cd893dd2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbaa0ff-e28b-4aa2-96f2-8b011b06a0e3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlRDhqQN {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlRDhqQN" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea038be-30fe-44ef-bb2f-d6a90e328598]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rlRDhqQN'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf69e07-2008-4ee8-a1e8-3a7a7f461be3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdeafb9-74a0-422a-81c2-45049aa1409a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:28 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:28 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:28 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:28 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:28 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:28 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:19:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f57140-58f6-4ea5-a4e9-4d1625e6a2d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2, portal: 172.16.0.220,3260]
Apr 12 09:19:29 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2, portal: 172.16.0.220,3260] successful.
Apr 12 09:19:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291154.0429862, 7cec0e09-36ac-43c7-9299-819b65c9da6b => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:29 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] VM Stopped (Lifecycle Event)
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0db1ec9-6000-43c2-a0d4-f1afb1e8f408]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0e17a450-40b9-4c4b-82fd-7cab382429be None None] [instance: 7cec0e09-36ac-43c7-9299-819b65c9da6b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45d4954-73b7-428e-981a-5103fb184ca6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:29 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:29 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:29 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:19:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:29 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:29 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:29 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:19:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.033s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[14acf3ef-0cb0-42ae-b357-85eb7c50964e]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlRDhqQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No VIF found with MAC fa:16:3e:bb:c0:46, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-04c71230-3710-4bdc-b25f-bb041f845d9e tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.031s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] <== connect_volume: return (2677ms) {'type': 'block', 'scsi_wwn': '26463356335613638', 'path': '/dev/sde'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463356335613638', 'path': '/dev/sde'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'flavor' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:19:30 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:19:30 user nova-compute[71482]:   <source dev="/dev/sde"/>
Apr 12 09:19:30 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:19:30 user nova-compute[71482]:   <serial>d1961f4e-4a3f-46cc-95a2-6177a29efeb2</serial>
Apr 12 09:19:30 user nova-compute[71482]: </disk>
Apr 12 09:19:30 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received event network-vif-plugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] No waiting events found dispatching network-vif-plugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:30 user nova-compute[71482]: WARNING nova.compute.manager [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received unexpected event network-vif-plugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance with vm_state building and task_state spawning.
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received event network-vif-plugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] No waiting events found dispatching network-vif-plugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:30 user nova-compute[71482]: WARNING nova.compute.manager [req-63a892f9-e587-4bfc-9000-9268d20e0ad9 req-ace53d8a-74a3-4be4-b9cd-296e918dbe2f service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received unexpected event network-vif-plugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance with vm_state building and task_state spawning.
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No VIF found with MAC fa:16:3e:48:07:99, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:19:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b0dc201d-0200-494e-baf4-b444a73c6293 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.218s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:31 user nova-compute[71482]: INFO nova.compute.manager [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Rescuing
Apr 12 09:19:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquired lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291171.7074296, 73c2cdd1-9214-4678-91a0-40fdb74403a2 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:31 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] VM Resumed (Lifecycle Event)
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Instance spawned successfully.
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:19:31 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291171.7106817, 73c2cdd1-9214-4678-91a0-40fdb74403a2 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:31 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] VM Started (Lifecycle Event)
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:19:31 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:19:31 user nova-compute[71482]: INFO nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Took 7.67 seconds to spawn the instance on the hypervisor.
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating instance_info_cache with network_info: [{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Releasing lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:31 user nova-compute[71482]: INFO nova.compute.manager [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Took 8.52 seconds to build instance.
Apr 12 09:19:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ad6785-0941-40dd-8997-aa764166510e tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.629s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-unplugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-unplugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:32 user nova-compute[71482]: WARNING nova.compute.manager [req-beac3572-7fd0-44cc-af4c-4e59dce961c7 req-f57db410-6a63-47dd-b58b-9475fa4080f0 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-unplugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state active and task_state rescuing.
Apr 12 09:19:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Instance destroyed successfully.
Apr 12 09:19:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Attempting rescue
Apr 12 09:19:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Port dc64c2a8-533c-40df-b88e-c059cb9cda89 binding to destination host user is already ACTIVE {{(pid=71482) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Instance directory exists: not creating {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 09:19:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Creating image(s)
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue" returned: 0 in 0.070s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'migration_context' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Start _get_guest_xml network_info=[{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "vif_mac": "fa:16:3e:48:07:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'resources' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:33 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:33 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1045691490',display_name='tempest-ServerRescueNegativeTestJSON-server-1045691490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1045691490',id=21,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRFQGCKpi8fjGcdpMDws7TZ+hZpwQGB4rtL60LdXbaRXqJvmTcXhTPGYdQ+Z42mEAB4P05g7T0Z0J2ARvc+I4t9vDocY1CSO+itTj8pMWaDXEEILwFmJvFWolS0ihRs3g==',key_name='tempest-keypair-1774942187',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-i1bjiuzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:17:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b983634234693ba04a3097c2a129b',uuid=0fe0c221-d660-4a7e-9fd8-5d9b49c659d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "vif_mac": "fa:16:3e:48:07:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "vif_mac": "fa:16:3e:48:07:99"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:07:99,bridge_name='br-int',has_traffic_filtering=True,id=a0e06b9c-27fc-47a2-a5d1-0da741a09eaa,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e06b9c-27') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:19:33 user nova-compute[71482]:   <uuid>0fe0c221-d660-4a7e-9fd8-5d9b49c659d0</uuid>
Apr 12 09:19:33 user nova-compute[71482]:   <name>instance-00000015</name>
Apr 12 09:19:33 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:19:33 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:19:33 user nova-compute[71482]:   <metadata>
Apr 12 09:19:33 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:19:33 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:19:33 user nova-compute[71482]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1045691490</nova:name>
Apr 12 09:19:33 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:19:33</nova:creationTime>
Apr 12 09:19:33 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:19:33 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:19:33 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:19:33 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:19:33 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:19:33 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:19:33 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:19:33 user nova-compute[71482]:       <nova:owner>
Apr 12 09:19:33 user nova-compute[71482]:         <nova:user uuid="7f6b983634234693ba04a3097c2a129b">tempest-ServerRescueNegativeTestJSON-480181232-project-member</nova:user>
Apr 12 09:19:33 user nova-compute[71482]:         <nova:project uuid="1c3cc8ab6ab244b1badb6fea347d64ea">tempest-ServerRescueNegativeTestJSON-480181232</nova:project>
Apr 12 09:19:33 user nova-compute[71482]:       </nova:owner>
Apr 12 09:19:33 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:19:33 user nova-compute[71482]:       <nova:ports>
Apr 12 09:19:33 user nova-compute[71482]:         <nova:port uuid="a0e06b9c-27fc-47a2-a5d1-0da741a09eaa">
Apr 12 09:19:33 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:19:33 user nova-compute[71482]:         </nova:port>
Apr 12 09:19:33 user nova-compute[71482]:       </nova:ports>
Apr 12 09:19:33 user nova-compute[71482]:     </nova:instance>
Apr 12 09:19:33 user nova-compute[71482]:   </metadata>
Apr 12 09:19:33 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:19:33 user nova-compute[71482]:     <system>
Apr 12 09:19:33 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:19:33 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:19:33 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:19:33 user nova-compute[71482]:       <entry name="serial">0fe0c221-d660-4a7e-9fd8-5d9b49c659d0</entry>
Apr 12 09:19:33 user nova-compute[71482]:       <entry name="uuid">0fe0c221-d660-4a7e-9fd8-5d9b49c659d0</entry>
Apr 12 09:19:33 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:19:33 user nova-compute[71482]:     </system>
Apr 12 09:19:33 user nova-compute[71482]:   </sysinfo>
Apr 12 09:19:33 user nova-compute[71482]:   <os>
Apr 12 09:19:33 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:19:33 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:19:33 user nova-compute[71482]:   </os>
Apr 12 09:19:33 user nova-compute[71482]:   <features>
Apr 12 09:19:33 user nova-compute[71482]:     <acpi/>
Apr 12 09:19:33 user nova-compute[71482]:     <apic/>
Apr 12 09:19:33 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:19:33 user nova-compute[71482]:   </features>
Apr 12 09:19:33 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:19:33 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:19:33 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:19:33 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:19:33 user nova-compute[71482]:   </clock>
Apr 12 09:19:33 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:19:33 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:19:33 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:19:33 user nova-compute[71482]:   </cpu>
Apr 12 09:19:33 user nova-compute[71482]:   <devices>
Apr 12 09:19:33 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:19:33 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:19:33 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue"/>
Apr 12 09:19:33 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:19:33 user nova-compute[71482]:     </disk>
Apr 12 09:19:33 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:19:33 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:19:33 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk"/>
Apr 12 09:19:33 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:19:33 user nova-compute[71482]:     </disk>
Apr 12 09:19:33 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:19:33 user nova-compute[71482]:       <mac address="fa:16:3e:48:07:99"/>
Apr 12 09:19:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:19:33 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:19:33 user nova-compute[71482]:       <target dev="tapa0e06b9c-27"/>
Apr 12 09:19:33 user nova-compute[71482]:     </interface>
Apr 12 09:19:33 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:19:33 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/console.log" append="off"/>
Apr 12 09:19:33 user nova-compute[71482]:     </serial>
Apr 12 09:19:33 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:19:33 user nova-compute[71482]:     <video>
Apr 12 09:19:33 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:19:33 user nova-compute[71482]:     </video>
Apr 12 09:19:33 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:19:33 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:19:33 user nova-compute[71482]:     </rng>
Apr 12 09:19:33 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:19:33 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:19:33 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:19:33 user nova-compute[71482]:     </memballoon>
Apr 12 09:19:33 user nova-compute[71482]:   </devices>
Apr 12 09:19:33 user nova-compute[71482]: </domain>
Apr 12 09:19:33 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:19:33 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Instance destroyed successfully.
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] No VIF found with MAC fa:16:3e:48:07:99, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:19:33 user nova-compute[71482]: INFO nova.compute.claims [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Claim successful on node user
Apr 12 09:19:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Creating tmpfile /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/tmphmm43hud to verify with other compute node that the instance is on the same shared storage. {{(pid=71482) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:19:33 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:19:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.policy [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:19:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Creating image(s)
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "/opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "/opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:34 user nova-compute[71482]: WARNING nova.compute.manager [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state active and task_state rescuing.
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:34 user nova-compute[71482]: WARNING nova.compute.manager [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state resized and task_state resize_reverting.
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:34 user nova-compute[71482]: WARNING nova.compute.manager [req-ba94128f-7e9f-4fda-b415-7dedd16f780f req-c946f4d4-70ce-406a-925a-ef0657657e90 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state resized and task_state resize_reverting.
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk 1073741824" returned: 0 in 0.049s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Cannot resize image /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.objects.instance [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'migration_context' on Instance uuid dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Ensure instance console log exists: /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance destroyed successfully.
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'resources' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG os_vif [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc64c2a8-53, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:35 user nova-compute[71482]: INFO os_vif [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53')
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:19:35 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Successfully created port: 45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a92a07b-528b-452d-834e-ee22fdd6be02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:19:35 user nova-compute[71482]: No targets found.
Apr 12 09:19:35 user nova-compute[71482]: iSNS:
Apr 12 09:19:35 user nova-compute[71482]: No targets found.
Apr 12 09:19:35 user nova-compute[71482]: STATIC:
Apr 12 09:19:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58
Apr 12 09:19:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:19:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:19:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86
Apr 12 09:19:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:19:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:19:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:19:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:19:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:19:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2
Apr 12 09:19:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:19:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:19:35 user nova-compute[71482]: FIRMWARE:
Apr 12 09:19:35 user nova-compute[71482]: No targets found.
Apr 12 09:19:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:19:35 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:19:35 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf2d91-a20b-4b06-a8d0-8d039cab1b7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e13e22-af11-49c1-a5dd-3db0b521ae5e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:35 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:35 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:35 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:19:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:35 user nova-compute[71482]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:35 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:35 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:19:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f934436fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58'): ({'sdd'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Removing single pathed devices sdd {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d679bba-9156-4979-81cd-cb20a3bcc587]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9704ff-a89e-4597-97be-645abbc298f9]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flushing IO for device /dev/sdd {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bcc961-f7a1-4928-8715-f1cc0c36077a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa5bf00-d908-4d04-8e20-d36a355f72bc]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[621a9ba5-fe5b-43e1-ad0e-dd08a3ec3a96]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03784c44-79ae-487e-8d49-0147a36de995]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]
Apr 12 09:19:35 user nova-compute[71482]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.
Apr 12 09:19:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28b8b5-a6d2-4128-873a-677e1963b392]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== disconnect_volume: return (357ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291160.7817109, 25232386-f51a-434b-9280-c4dd30b55f3d => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:35 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] VM Stopped (Lifecycle Event)
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d23446f6-6b80-4956-9efc-a3ff70b26f0d None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Successfully updated port: 45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "refresh_cache-dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquired lock "refresh_cache-dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received event network-changed-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Refreshing instance network info cache due to event network-changed-45389f3c-d497-46bd-bb7e-78f6c977674a. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] Acquiring lock "refresh_cache-dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:35 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Updating instance_info_cache with network_info: [{"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Releasing lock "refresh_cache-dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Instance network_info: |[{"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] Acquired lock "refresh_cache-dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Refreshing network info cache for port 45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Start _get_guest_xml network_info=[{"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:19:36 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:36 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451080542',display_name='tempest-AttachVolumeNegativeTest-server-451080542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451080542',id=23,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP51TTucuI9vEnyIAeef4Vp7Qq8j+8RA/jR7dkk8rngksIPTjdIVW+QOnQJiPAfRnKEEkjxS/df5PFigO92DmtNDYjq1D17xkh5ij081vpoDIttqa+Y9KL2Mvy4sU65NvQ==',key_name='tempest-keypair-874485369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-g3aorn55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:19:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=45389f3c-d497-46bd-bb7e-78f6c977674a,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45389f3c-d4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'pci_devices' on Instance uuid dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:19:36 user nova-compute[71482]:   <uuid>dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6</uuid>
Apr 12 09:19:36 user nova-compute[71482]:   <name>instance-00000017</name>
Apr 12 09:19:36 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:19:36 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:19:36 user nova-compute[71482]:   <metadata>
Apr 12 09:19:36 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:19:36 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:19:36 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeNegativeTest-server-451080542</nova:name>
Apr 12 09:19:36 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:19:36</nova:creationTime>
Apr 12 09:19:36 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:19:36 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:19:36 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:19:36 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:19:36 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:19:36 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:19:36 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:19:36 user nova-compute[71482]:       <nova:owner>
Apr 12 09:19:36 user nova-compute[71482]:         <nova:user uuid="5f91fed06f9547d29125f38fe2d47221">tempest-AttachVolumeNegativeTest-395431601-project-member</nova:user>
Apr 12 09:19:36 user nova-compute[71482]:         <nova:project uuid="37b4beaf457f4120bcbcd2b033d5c3db">tempest-AttachVolumeNegativeTest-395431601</nova:project>
Apr 12 09:19:36 user nova-compute[71482]:       </nova:owner>
Apr 12 09:19:36 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:19:36 user nova-compute[71482]:       <nova:ports>
Apr 12 09:19:36 user nova-compute[71482]:         <nova:port uuid="45389f3c-d497-46bd-bb7e-78f6c977674a">
Apr 12 09:19:36 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 09:19:36 user nova-compute[71482]:         </nova:port>
Apr 12 09:19:36 user nova-compute[71482]:       </nova:ports>
Apr 12 09:19:36 user nova-compute[71482]:     </nova:instance>
Apr 12 09:19:36 user nova-compute[71482]:   </metadata>
Apr 12 09:19:36 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:19:36 user nova-compute[71482]:     <system>
Apr 12 09:19:36 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:19:36 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:19:36 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:19:36 user nova-compute[71482]:       <entry name="serial">dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6</entry>
Apr 12 09:19:36 user nova-compute[71482]:       <entry name="uuid">dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6</entry>
Apr 12 09:19:36 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:19:36 user nova-compute[71482]:     </system>
Apr 12 09:19:36 user nova-compute[71482]:   </sysinfo>
Apr 12 09:19:36 user nova-compute[71482]:   <os>
Apr 12 09:19:36 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:19:36 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:19:36 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:19:36 user nova-compute[71482]:   </os>
Apr 12 09:19:36 user nova-compute[71482]:   <features>
Apr 12 09:19:36 user nova-compute[71482]:     <acpi/>
Apr 12 09:19:36 user nova-compute[71482]:     <apic/>
Apr 12 09:19:36 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:19:36 user nova-compute[71482]:   </features>
Apr 12 09:19:36 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:19:36 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:19:36 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:19:36 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:19:36 user nova-compute[71482]:   </clock>
Apr 12 09:19:36 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:19:36 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:19:36 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:19:36 user nova-compute[71482]:   </cpu>
Apr 12 09:19:36 user nova-compute[71482]:   <devices>
Apr 12 09:19:36 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:19:36 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:19:36 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk"/>
Apr 12 09:19:36 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:19:36 user nova-compute[71482]:     </disk>
Apr 12 09:19:36 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:19:36 user nova-compute[71482]:       <mac address="fa:16:3e:92:4a:a8"/>
Apr 12 09:19:36 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:19:36 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:19:36 user nova-compute[71482]:       <target dev="tap45389f3c-d4"/>
Apr 12 09:19:36 user nova-compute[71482]:     </interface>
Apr 12 09:19:36 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:19:36 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/console.log" append="off"/>
Apr 12 09:19:36 user nova-compute[71482]:     </serial>
Apr 12 09:19:36 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:19:36 user nova-compute[71482]:     <video>
Apr 12 09:19:36 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:19:36 user nova-compute[71482]:     </video>
Apr 12 09:19:36 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:19:36 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:19:36 user nova-compute[71482]:     </rng>
Apr 12 09:19:36 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:19:36 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:19:36 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:19:36 user nova-compute[71482]:     </memballoon>
Apr 12 09:19:36 user nova-compute[71482]:   </devices>
Apr 12 09:19:36 user nova-compute[71482]: </domain>
Apr 12 09:19:36 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451080542',display_name='tempest-AttachVolumeNegativeTest-server-451080542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451080542',id=23,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP51TTucuI9vEnyIAeef4Vp7Qq8j+8RA/jR7dkk8rngksIPTjdIVW+QOnQJiPAfRnKEEkjxS/df5PFigO92DmtNDYjq1D17xkh5ij081vpoDIttqa+Y9KL2Mvy4sU65NvQ==',key_name='tempest-keypair-874485369',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-g3aorn55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:19:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=45389f3c-d497-46bd-bb7e-78f6c977674a,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45389f3c-d4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG os_vif [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=45389f3c-d497-46bd-bb7e-78f6c977674a,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45389f3c-d4') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45389f3c-d4, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45389f3c-d4, col_values=(('external_ids', {'iface-id': '45389f3c-d497-46bd-bb7e-78f6c977674a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:4a:a8', 'vm-uuid': 'dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:36 user nova-compute[71482]: INFO os_vif [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=45389f3c-d497-46bd-bb7e-78f6c977674a,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45389f3c-d4')
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No VIF found with MAC fa:16:3e:92:4a:a8, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'migration_context' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:36 user nova-compute[71482]: WARNING nova.compute.manager [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state active and task_state rescuing.
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:36 user nova-compute[71482]: WARNING nova.compute.manager [req-491a77b0-bd2d-4ecc-835d-114ea010102d req-0afacd7e-849f-48cd-a78a-ab552b49f25b service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state active and task_state rescuing.
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Updated VIF entry in instance network info cache for port 45389f3c-d497-46bd-bb7e-78f6c977674a. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Updating instance_info_cache with network_info: [{"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-26b29940-9b37-4cbe-b10e-9cd4ce27269f req-79e2e1ad-e6f6-4a30-8b35-848974e879dc service nova] Releasing lock "refresh_cache-dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:19:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.470s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:37 user nova-compute[71482]: INFO nova.compute.manager [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Swapping old allocation on dict_keys(['bde6c1bb-b134-4972-af52-5525f319b91c']) held by migration b4e9d3fa-6964-4d5d-862f-023b3af68632 for instance
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Overwriting current allocation {'allocations': {'bde6c1bb-b134-4972-af52-5525f319b91c': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 27}}, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'user_id': '375db5b9a80244d3878822049230ba47', 'consumer_generation': 1} on consumer 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291177.149198, 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:37 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] VM Resumed (Lifecycle Event)
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e94c9ce9-c4a0-4098-a4c0-f6999d535d14 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:19:37 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291177.151136, 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:37 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] VM Started (Lifecycle Event)
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG os_brick.utils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4b4eed-0e0d-4dbb-a787-5f14812e5d11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.041s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73884ca-bbc5-41db-8da7-6e6857fe6b8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[545534e6-8b95-40c2-a406-0e0e4e77caa0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[465eb94d-285a-453e-856b-76f624e98c7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:19:37 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:19:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c866e0fd-ffb0-45a5-b296-7c7fae550402]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG os_brick.utils [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:19:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received event network-vif-plugged-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Acquiring lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] No waiting events found dispatching network-vif-plugged-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:38 user nova-compute[71482]: WARNING nova.compute.manager [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received unexpected event network-vif-plugged-45389f3c-d497-46bd-bb7e-78f6c977674a for instance with vm_state building and task_state spawning.
Apr 12 09:19:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received event network-vif-plugged-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Acquiring lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] No waiting events found dispatching network-vif-plugged-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:38 user nova-compute[71482]: WARNING nova.compute.manager [req-bb332cdf-059b-4276-b95c-226fd9dd611b req-aeb063ad-019a-47da-b61f-6a9452b76a98 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received unexpected event network-vif-plugged-45389f3c-d497-46bd-bb7e-78f6c977674a for instance with vm_state building and task_state spawning.
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291179.942594, dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:39 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] VM Resumed (Lifecycle Event)
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:19:39 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Instance spawned successfully.
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:19:40 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:19:40 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291179.949794, dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:40 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] VM Started (Lifecycle Event)
Apr 12 09:19:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:19:40 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:19:40 user nova-compute[71482]: INFO nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Took 5.83 seconds to spawn the instance on the hypervisor.
Apr 12 09:19:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:40 user nova-compute[71482]: INFO nova.compute.manager [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Took 6.68 seconds to build instance.
Apr 12 09:19:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d677df34-4b89-4387-bb26-395da67fb821 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.778s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Starting finish_revert_migration {{(pid=71482) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Start _get_guest_xml network_info=[{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3a674c23-0dd8-42a3-83f5-e51e284be23a', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4f211820-161b-4bef-b25d-ced137325da1', 'attached_at': '2023-04-12T09:19:42.000000', 'detached_at': '', 'volume_id': '7d6b141c-5f82-4aed-b319-8579a78c6c58', 'serial': '7d6b141c-5f82-4aed-b319-8579a78c6c58'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:19:42 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:42 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:19:42 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:19:42 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:19:42 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3a609-7199-4777-bbb4-1a6a74af883b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:19:42 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d061ca-38c4-4895-957a-1eaab2c6c1bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58] added
Apr 12 09:19:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[147ba626-c431-426b-8fe6-762c389d27c4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e1a1cd-eed4-4de1-a48d-438693041d37]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwjLxYMF {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwjLxYMF" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16869c-0bad-4ac3-b0aa-07dbc8e833f3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gwjLxYMF'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dac3e92-59b7-46b9-90be-e73000436af0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc7bc46-7650-4661-afbd-c1f051788cc9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb52cf57-0de7-44c4-995e-da5f6cfac1cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]
Apr 12 09:19:42 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.
Apr 12 09:19:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ca03e9-5bbb-4c0c-ac8a-668990052e6e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e54f6c-2f7d-4965-b8e8-f82275df1329]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:19:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[500f66f0-68f3-4084-ad74-9a29fb8fc91e]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:19:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23961393632656563', 'path': '/dev/sdd'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961393632656563', 'path': '/dev/sdd'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:19:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:19:43 user nova-compute[71482]:   <uuid>4f211820-161b-4bef-b25d-ced137325da1</uuid>
Apr 12 09:19:43 user nova-compute[71482]:   <name>instance-00000003</name>
Apr 12 09:19:43 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:19:43 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:19:43 user nova-compute[71482]:   <metadata>
Apr 12 09:19:43 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:19:43 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:19:43 user nova-compute[71482]:       <nova:name>tempest-ServerActionsTestJSON-server-1204181922</nova:name>
Apr 12 09:19:43 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:19:42</nova:creationTime>
Apr 12 09:19:43 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:19:43 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:19:43 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:19:43 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:19:43 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:19:43 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:19:43 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:19:43 user nova-compute[71482]:       <nova:owner>
Apr 12 09:19:43 user nova-compute[71482]:         <nova:user uuid="375db5b9a80244d3878822049230ba47">tempest-ServerActionsTestJSON-1142062861-project-member</nova:user>
Apr 12 09:19:43 user nova-compute[71482]:         <nova:project uuid="20b8c89c46bb460f9f94be9426a22bb8">tempest-ServerActionsTestJSON-1142062861</nova:project>
Apr 12 09:19:43 user nova-compute[71482]:       </nova:owner>
Apr 12 09:19:43 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:19:43 user nova-compute[71482]:       <nova:ports>
Apr 12 09:19:43 user nova-compute[71482]:         <nova:port uuid="dc64c2a8-533c-40df-b88e-c059cb9cda89">
Apr 12 09:19:43 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 09:19:43 user nova-compute[71482]:         </nova:port>
Apr 12 09:19:43 user nova-compute[71482]:       </nova:ports>
Apr 12 09:19:43 user nova-compute[71482]:     </nova:instance>
Apr 12 09:19:43 user nova-compute[71482]:   </metadata>
Apr 12 09:19:43 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:19:43 user nova-compute[71482]:     <system>
Apr 12 09:19:43 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:19:43 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:19:43 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:19:43 user nova-compute[71482]:       <entry name="serial">4f211820-161b-4bef-b25d-ced137325da1</entry>
Apr 12 09:19:43 user nova-compute[71482]:       <entry name="uuid">4f211820-161b-4bef-b25d-ced137325da1</entry>
Apr 12 09:19:43 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:19:43 user nova-compute[71482]:     </system>
Apr 12 09:19:43 user nova-compute[71482]:   </sysinfo>
Apr 12 09:19:43 user nova-compute[71482]:   <os>
Apr 12 09:19:43 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:19:43 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:19:43 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:19:43 user nova-compute[71482]:   </os>
Apr 12 09:19:43 user nova-compute[71482]:   <features>
Apr 12 09:19:43 user nova-compute[71482]:     <acpi/>
Apr 12 09:19:43 user nova-compute[71482]:     <apic/>
Apr 12 09:19:43 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:19:43 user nova-compute[71482]:   </features>
Apr 12 09:19:43 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:19:43 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:19:43 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:19:43 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:19:43 user nova-compute[71482]:   </clock>
Apr 12 09:19:43 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:19:43 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:19:43 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:19:43 user nova-compute[71482]:   </cpu>
Apr 12 09:19:43 user nova-compute[71482]:   <devices>
Apr 12 09:19:43 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:19:43 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:19:43 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk"/>
Apr 12 09:19:43 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:19:43 user nova-compute[71482]:     </disk>
Apr 12 09:19:43 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:19:43 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:19:43 user nova-compute[71482]:       <source dev="/dev/sdd"/>
Apr 12 09:19:43 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:19:43 user nova-compute[71482]:       <serial>7d6b141c-5f82-4aed-b319-8579a78c6c58</serial>
Apr 12 09:19:43 user nova-compute[71482]:     </disk>
Apr 12 09:19:43 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:19:43 user nova-compute[71482]:       <mac address="fa:16:3e:9b:4e:53"/>
Apr 12 09:19:43 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:19:43 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:19:43 user nova-compute[71482]:       <target dev="tapdc64c2a8-53"/>
Apr 12 09:19:43 user nova-compute[71482]:     </interface>
Apr 12 09:19:43 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:19:43 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/console.log" append="off"/>
Apr 12 09:19:43 user nova-compute[71482]:     </serial>
Apr 12 09:19:43 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:19:43 user nova-compute[71482]:     <video>
Apr 12 09:19:43 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:19:43 user nova-compute[71482]:     </video>
Apr 12 09:19:43 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:19:43 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:19:43 user nova-compute[71482]:     </rng>
Apr 12 09:19:43 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:19:43 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:19:43 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:19:43 user nova-compute[71482]:     </memballoon>
Apr 12 09:19:43 user nova-compute[71482]:   </devices>
Apr 12 09:19:43 user nova-compute[71482]: </domain>
Apr 12 09:19:43 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:17:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:19:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG os_vif [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc64c2a8-53, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdc64c2a8-53, col_values=(('external_ids', {'iface-id': 'dc64c2a8-533c-40df-b88e-c059cb9cda89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:4e:53', 'vm-uuid': '4f211820-161b-4bef-b25d-ced137325da1'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:19:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:19:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:44 user nova-compute[71482]: INFO os_vif [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53')
Apr 12 09:19:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:45 user nova-compute[71482]: WARNING nova.compute.manager [req-65ba93bc-ef88-42c2-b644-48df52642d7c req-d083f0b4-0ee1-48f0-9f3a-da1b680d7b3b service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state resized and task_state resize_reverting.
Apr 12 09:19:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 4f211820-161b-4bef-b25d-ced137325da1 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291187.5788174, 4f211820-161b-4bef-b25d-ced137325da1 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:47 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Resumed (Lifecycle Event)
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:19:47 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance running successfully.
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] finish_revert_migration finished successfully. {{(pid=71482) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:19:47 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291187.580167, 4f211820-161b-4bef-b25d-ced137325da1 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:19:47 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Started (Lifecycle Event)
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:19:47 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:19:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:19:47 user nova-compute[71482]: WARNING nova.compute.manager [req-5edf96f1-3756-4397-ac01-8006be286626 req-0c0cad65-8725-4b17-a9d9-1e15650d96f1 service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state resized and task_state resize_reverting.
Apr 12 09:19:47 user nova-compute[71482]: INFO nova.compute.manager [None req-b3f3ab6b-0f6d-4b41-a6e8-12e8cb1225bd tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance to original state: 'active'
Apr 12 09:19:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updating instance_info_cache with network_info: [{"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:19:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:19:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:19:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:19:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:55 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:19:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:01 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:20:01 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7774MB free_disk=26.210548400878906GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e442604c-86f4-45e1-9407-1764133852ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:20:01 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:20:02 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:20:02 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:20:02 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:20:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.672s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "825afa91-cf8c-477a-afbf-40af95b81c76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:20:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:20:08 user nova-compute[71482]: INFO nova.compute.claims [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Claim successful on node user
Apr 12 09:20:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:09 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:20:09 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:20:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:20:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:20:09 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:20:09 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:20:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:20:09 user nova-compute[71482]: INFO nova.virt.block_device [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Booting with volume-backed-image 4a835d20-3733-4a8b-bebd-54dfa6135dd6 at /dev/vda
Apr 12 09:20:09 user nova-compute[71482]: DEBUG nova.policy [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc51704e74b045ad9733a43aec982390', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6ce4a0f4dad40c18fd8a83470c15f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:20:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Successfully created port: 99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Successfully updated port: 99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquired lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-changed-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Refreshing instance network info cache due to event network-changed-99f71fe3-cfc5-48aa-99e5-7b826f7a9732. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] Acquiring lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Updating instance_info_cache with network_info: [{"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Releasing lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Instance network_info: |[{"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] Acquired lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:20:11 user nova-compute[71482]: DEBUG nova.network.neutron [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Refreshing network info cache for port 99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:20:12 user nova-compute[71482]: DEBUG nova.network.neutron [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Updated VIF entry in instance network info cache for port 99f71fe3-cfc5-48aa-99e5-7b826f7a9732. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:20:12 user nova-compute[71482]: DEBUG nova.network.neutron [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Updating instance_info_cache with network_info: [{"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:20:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0b6f4942-1431-4182-b6dd-d207f198c165 req-823cc003-d7a1-42e2-972b-2546abb6b3fc service nova] Releasing lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:20:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG os_brick.utils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3562d4-1bec-4d86-8058-19be8d4cd4ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d1c93a-4fad-415e-8d7c-6ef75cd3653c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec855f7-0e16-423a-855e-5565f235ce17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6f6a1-742d-4b26-859f-a4ecd4548bd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:20:15 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:20:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f37caa0-2559-4739-b9c0-f3d23ddebe5a]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG os_brick.utils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:20:15 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Updating existing volume attachment record: 205ce8fe-d96a-4270-b4b7-fc3c366450bd {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:20:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:20:19 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Creating image(s)
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Ensure instance console log exists: /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Start _get_guest_xml network_info=[{"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '205ce8fe-d96a-4270-b4b7-fc3c366450bd', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMQfOprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '825afa91-cf8c-477a-afbf-40af95b81c76', 'attached_at': '', 'detached_at': '', 'volume_id': '22ce6dbc-4a22-4480-8874-e107b53f518d', 'serial': '22ce6dbc-4a22-4480-8874-e107b53f518d'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:20:19 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:20:19 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMQfOprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:20:19 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:20:19 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:20:19 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fc8c02-fa0a-45b8-9a0d-8e0d7e59d90a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:20:19 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2e5778-bc7c-4af6-857e-d87a4cf51a7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d] added
Apr 12 09:20:19 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7042d3cd-43d3-4038-939f-64f0bfcca543]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae9f0eb-3111-4e41-bc38-8bd313c73082]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMQfOprs {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMQfOprs" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[17184d6c-b531-4138-9595-d16285581b42]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nMQfOprs'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd5c8e-b91f-4b19-8abf-ffbf745f1874]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd1632b-fdc6-4762-9dfd-1a585624838f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:20:19 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:20:19 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:20:19 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:20:19 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:20:19 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:20:19 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:20:19 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:20:19 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5becf8-6ef0-4d83-af64-e101daca42c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d, portal: 172.16.0.220,3260]
Apr 12 09:20:19 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d, portal: 172.16.0.220,3260] successful.
Apr 12 09:20:19 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeec99bc-db79-4211-bfc3-75f1fddee8cd]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6037d6-7539-4b51-9fdc-86ea3400a6e3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:20:20 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:20:20 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:20:20 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:20:20 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:20:20 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:20:20 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:20:20 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:20:20 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:20:20 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:20:20 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf67922f-fb9e-44ae-8478-59ac2ff12393]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMQfOprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:20:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23933636138373835', 'path': '/dev/sdf'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933636138373835', 'path': '/dev/sdf'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1533143626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1533143626',id=24,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-ob0dtmdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:20:10Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=825afa91-cf8c-477a-afbf-40af95b81c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:ac:21,bridge_name='br-int',has_traffic_filtering=True,id=99f71fe3-cfc5-48aa-99e5-7b826f7a9732,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f71fe3-cf') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'pci_devices' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:20:21 user nova-compute[71482]:   <uuid>825afa91-cf8c-477a-afbf-40af95b81c76</uuid>
Apr 12 09:20:21 user nova-compute[71482]:   <name>instance-00000018</name>
Apr 12 09:20:21 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:20:21 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:20:21 user nova-compute[71482]:   <metadata>
Apr 12 09:20:21 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:20:21 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:20:21 user nova-compute[71482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1533143626</nova:name>
Apr 12 09:20:21 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:20:19</nova:creationTime>
Apr 12 09:20:21 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:20:21 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:20:21 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:20:21 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:20:21 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:20:21 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:20:21 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:20:21 user nova-compute[71482]:       <nova:owner>
Apr 12 09:20:21 user nova-compute[71482]:         <nova:user uuid="cc51704e74b045ad9733a43aec982390">tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member</nova:user>
Apr 12 09:20:21 user nova-compute[71482]:         <nova:project uuid="a6ce4a0f4dad40c18fd8a83470c15f05">tempest-ServerBootFromVolumeStableRescueTest-1244466684</nova:project>
Apr 12 09:20:21 user nova-compute[71482]:       </nova:owner>
Apr 12 09:20:21 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:20:21 user nova-compute[71482]:       <nova:ports>
Apr 12 09:20:21 user nova-compute[71482]:         <nova:port uuid="99f71fe3-cfc5-48aa-99e5-7b826f7a9732">
Apr 12 09:20:21 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 09:20:21 user nova-compute[71482]:         </nova:port>
Apr 12 09:20:21 user nova-compute[71482]:       </nova:ports>
Apr 12 09:20:21 user nova-compute[71482]:     </nova:instance>
Apr 12 09:20:21 user nova-compute[71482]:   </metadata>
Apr 12 09:20:21 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:20:21 user nova-compute[71482]:     <system>
Apr 12 09:20:21 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:20:21 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:20:21 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:20:21 user nova-compute[71482]:       <entry name="serial">825afa91-cf8c-477a-afbf-40af95b81c76</entry>
Apr 12 09:20:21 user nova-compute[71482]:       <entry name="uuid">825afa91-cf8c-477a-afbf-40af95b81c76</entry>
Apr 12 09:20:21 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:20:21 user nova-compute[71482]:     </system>
Apr 12 09:20:21 user nova-compute[71482]:   </sysinfo>
Apr 12 09:20:21 user nova-compute[71482]:   <os>
Apr 12 09:20:21 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:20:21 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:20:21 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:20:21 user nova-compute[71482]:   </os>
Apr 12 09:20:21 user nova-compute[71482]:   <features>
Apr 12 09:20:21 user nova-compute[71482]:     <acpi/>
Apr 12 09:20:21 user nova-compute[71482]:     <apic/>
Apr 12 09:20:21 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:20:21 user nova-compute[71482]:   </features>
Apr 12 09:20:21 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:20:21 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:20:21 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:20:21 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:20:21 user nova-compute[71482]:   </clock>
Apr 12 09:20:21 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:20:21 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:20:21 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:20:21 user nova-compute[71482]:   </cpu>
Apr 12 09:20:21 user nova-compute[71482]:   <devices>
Apr 12 09:20:21 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:20:21 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:20:21 user nova-compute[71482]:       <source dev="/dev/sdf"/>
Apr 12 09:20:21 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:20:21 user nova-compute[71482]:       <serial>22ce6dbc-4a22-4480-8874-e107b53f518d</serial>
Apr 12 09:20:21 user nova-compute[71482]:     </disk>
Apr 12 09:20:21 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:20:21 user nova-compute[71482]:       <mac address="fa:16:3e:70:ac:21"/>
Apr 12 09:20:21 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:20:21 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:20:21 user nova-compute[71482]:       <target dev="tap99f71fe3-cf"/>
Apr 12 09:20:21 user nova-compute[71482]:     </interface>
Apr 12 09:20:21 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:20:21 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/console.log" append="off"/>
Apr 12 09:20:21 user nova-compute[71482]:     </serial>
Apr 12 09:20:21 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:20:21 user nova-compute[71482]:     <video>
Apr 12 09:20:21 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:20:21 user nova-compute[71482]:     </video>
Apr 12 09:20:21 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:20:21 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:20:21 user nova-compute[71482]:     </rng>
Apr 12 09:20:21 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:20:21 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:20:21 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:20:21 user nova-compute[71482]:     </memballoon>
Apr 12 09:20:21 user nova-compute[71482]:   </devices>
Apr 12 09:20:21 user nova-compute[71482]: </domain>
Apr 12 09:20:21 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1533143626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1533143626',id=24,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-ob0dtmdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:20:10Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=825afa91-cf8c-477a-afbf-40af95b81c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:ac:21,bridge_name='br-int',has_traffic_filtering=True,id=99f71fe3-cfc5-48aa-99e5-7b826f7a9732,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f71fe3-cf') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG os_vif [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:ac:21,bridge_name='br-int',has_traffic_filtering=True,id=99f71fe3-cfc5-48aa-99e5-7b826f7a9732,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f71fe3-cf') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99f71fe3-cf, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99f71fe3-cf, col_values=(('external_ids', {'iface-id': '99f71fe3-cfc5-48aa-99e5-7b826f7a9732', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:ac:21', 'vm-uuid': '825afa91-cf8c-477a-afbf-40af95b81c76'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:21 user nova-compute[71482]: INFO os_vif [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:ac:21,bridge_name='br-int',has_traffic_filtering=True,id=99f71fe3-cfc5-48aa-99e5-7b826f7a9732,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f71fe3-cf')
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:20:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No VIF found with MAC fa:16:3e:70:ac:21, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:20:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:20:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:20:22 user nova-compute[71482]: WARNING nova.compute.manager [req-ac6606aa-c60c-4415-9735-874ad92a95d0 req-f6e22562-0d53-41b6-b78e-15e1ed73d9b1 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state building and task_state spawning.
Apr 12 09:20:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291224.6833572, 825afa91-cf8c-477a-afbf-40af95b81c76 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:20:24 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] VM Resumed (Lifecycle Event)
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:20:24 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Instance spawned successfully.
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:24 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291224.6877646, 825afa91-cf8c-477a-afbf-40af95b81c76 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:20:24 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] VM Started (Lifecycle Event)
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:20:24 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:20:24 user nova-compute[71482]: INFO nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:20:24 user nova-compute[71482]: WARNING nova.compute.manager [req-dd35c9b9-a931-4232-832d-2aba29324292 req-b598ad7e-69a0-4465-93aa-b78422511c1c service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state building and task_state spawning.
Apr 12 09:20:24 user nova-compute[71482]: INFO nova.compute.manager [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Took 16.10 seconds to build instance.
Apr 12 09:20:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b6f49c98-522f-4143-9eab-f70f95d32a2a tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "825afa91-cf8c-477a-afbf-40af95b81c76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.211s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:20:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:20:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:20:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:20:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "c14c316b-deba-4835-acb5-7674420fd8d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "c14c316b-deba-4835-acb5-7674420fd8d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:20:37 user nova-compute[71482]: INFO nova.compute.claims [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Claim successful on node user
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.network.neutron [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:20:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:20:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Creating image(s)
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "/opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "/opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "/opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG nova.policy [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e26e536926043d8add1c2672f965e70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c26312b501fe493389501c331ebbc5d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk 1073741824" returned: 0 in 0.114s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.126s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Cannot resize image /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lazy-loading 'migration_context' on Instance uuid c14c316b-deba-4835-acb5-7674420fd8d1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Ensure instance console log exists: /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:38 user nova-compute[71482]: DEBUG nova.network.neutron [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Successfully created port: 46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Successfully updated port: 46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "refresh_cache-c14c316b-deba-4835-acb5-7674420fd8d1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquired lock "refresh_cache-c14c316b-deba-4835-acb5-7674420fd8d1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received event network-changed-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Refreshing instance network info cache due to event network-changed-46d4458e-b33c-4f49-9625-e1ae1c191fb2. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] Acquiring lock "refresh_cache-c14c316b-deba-4835-acb5-7674420fd8d1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Updating instance_info_cache with network_info: [{"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Releasing lock "refresh_cache-c14c316b-deba-4835-acb5-7674420fd8d1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Instance network_info: |[{"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] Acquired lock "refresh_cache-c14c316b-deba-4835-acb5-7674420fd8d1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.network.neutron [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Refreshing network info cache for port 46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Start _get_guest_xml network_info=[{"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:20:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:20:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-197490685',display_name='tempest-VolumesNegativeTest-instance-197490685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-197490685',id=25,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c26312b501fe493389501c331ebbc5d0',ramdisk_id='',reservation_id='r-dw13mf5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1969108914',owner_user_name='tempest-VolumesNegativeTest-1969108914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:20:38Z,user_data=None,user_id='1e26e536926043d8add1c2672f965e70',uuid=c14c316b-deba-4835-acb5-7674420fd8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Converting VIF {"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8e:dd,bridge_name='br-int',has_traffic_filtering=True,id=46d4458e-b33c-4f49-9625-e1ae1c191fb2,network=Network(f08bb357-59fb-44cf-a11e-1eaf17bbe75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d4458e-b3') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lazy-loading 'pci_devices' on Instance uuid c14c316b-deba-4835-acb5-7674420fd8d1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:20:39 user nova-compute[71482]:   <uuid>c14c316b-deba-4835-acb5-7674420fd8d1</uuid>
Apr 12 09:20:39 user nova-compute[71482]:   <name>instance-00000019</name>
Apr 12 09:20:39 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:20:39 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:20:39 user nova-compute[71482]:   <metadata>
Apr 12 09:20:39 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:20:39 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:20:39 user nova-compute[71482]:       <nova:name>tempest-VolumesNegativeTest-instance-197490685</nova:name>
Apr 12 09:20:39 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:20:39</nova:creationTime>
Apr 12 09:20:39 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:20:39 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:20:39 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:20:39 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:20:39 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:20:39 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:20:39 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:20:39 user nova-compute[71482]:       <nova:owner>
Apr 12 09:20:39 user nova-compute[71482]:         <nova:user uuid="1e26e536926043d8add1c2672f965e70">tempest-VolumesNegativeTest-1969108914-project-member</nova:user>
Apr 12 09:20:39 user nova-compute[71482]:         <nova:project uuid="c26312b501fe493389501c331ebbc5d0">tempest-VolumesNegativeTest-1969108914</nova:project>
Apr 12 09:20:39 user nova-compute[71482]:       </nova:owner>
Apr 12 09:20:39 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:20:39 user nova-compute[71482]:       <nova:ports>
Apr 12 09:20:39 user nova-compute[71482]:         <nova:port uuid="46d4458e-b33c-4f49-9625-e1ae1c191fb2">
Apr 12 09:20:39 user nova-compute[71482]:           <nova:ip type="fixed" address="192.168.233.230" ipVersion="4"/>
Apr 12 09:20:39 user nova-compute[71482]:         </nova:port>
Apr 12 09:20:39 user nova-compute[71482]:       </nova:ports>
Apr 12 09:20:39 user nova-compute[71482]:     </nova:instance>
Apr 12 09:20:39 user nova-compute[71482]:   </metadata>
Apr 12 09:20:39 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:20:39 user nova-compute[71482]:     <system>
Apr 12 09:20:39 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:20:39 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:20:39 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:20:39 user nova-compute[71482]:       <entry name="serial">c14c316b-deba-4835-acb5-7674420fd8d1</entry>
Apr 12 09:20:39 user nova-compute[71482]:       <entry name="uuid">c14c316b-deba-4835-acb5-7674420fd8d1</entry>
Apr 12 09:20:39 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:20:39 user nova-compute[71482]:     </system>
Apr 12 09:20:39 user nova-compute[71482]:   </sysinfo>
Apr 12 09:20:39 user nova-compute[71482]:   <os>
Apr 12 09:20:39 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:20:39 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:20:39 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:20:39 user nova-compute[71482]:   </os>
Apr 12 09:20:39 user nova-compute[71482]:   <features>
Apr 12 09:20:39 user nova-compute[71482]:     <acpi/>
Apr 12 09:20:39 user nova-compute[71482]:     <apic/>
Apr 12 09:20:39 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:20:39 user nova-compute[71482]:   </features>
Apr 12 09:20:39 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:20:39 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:20:39 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:20:39 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:20:39 user nova-compute[71482]:   </clock>
Apr 12 09:20:39 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:20:39 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:20:39 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:20:39 user nova-compute[71482]:   </cpu>
Apr 12 09:20:39 user nova-compute[71482]:   <devices>
Apr 12 09:20:39 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:20:39 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:20:39 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk"/>
Apr 12 09:20:39 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:20:39 user nova-compute[71482]:     </disk>
Apr 12 09:20:39 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:20:39 user nova-compute[71482]:       <mac address="fa:16:3e:49:8e:dd"/>
Apr 12 09:20:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:20:39 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:20:39 user nova-compute[71482]:       <target dev="tap46d4458e-b3"/>
Apr 12 09:20:39 user nova-compute[71482]:     </interface>
Apr 12 09:20:39 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:20:39 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/console.log" append="off"/>
Apr 12 09:20:39 user nova-compute[71482]:     </serial>
Apr 12 09:20:39 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:20:39 user nova-compute[71482]:     <video>
Apr 12 09:20:39 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:20:39 user nova-compute[71482]:     </video>
Apr 12 09:20:39 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:20:39 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:20:39 user nova-compute[71482]:     </rng>
Apr 12 09:20:39 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:20:39 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:20:39 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:20:39 user nova-compute[71482]:     </memballoon>
Apr 12 09:20:39 user nova-compute[71482]:   </devices>
Apr 12 09:20:39 user nova-compute[71482]: </domain>
Apr 12 09:20:39 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-197490685',display_name='tempest-VolumesNegativeTest-instance-197490685',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-197490685',id=25,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c26312b501fe493389501c331ebbc5d0',ramdisk_id='',reservation_id='r-dw13mf5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1969108914',owner_user_name='tempest-VolumesNegativeTest-1969108914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:20:38Z,user_data=None,user_id='1e26e536926043d8add1c2672f965e70',uuid=c14c316b-deba-4835-acb5-7674420fd8d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Converting VIF {"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8e:dd,bridge_name='br-int',has_traffic_filtering=True,id=46d4458e-b33c-4f49-9625-e1ae1c191fb2,network=Network(f08bb357-59fb-44cf-a11e-1eaf17bbe75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d4458e-b3') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG os_vif [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8e:dd,bridge_name='br-int',has_traffic_filtering=True,id=46d4458e-b33c-4f49-9625-e1ae1c191fb2,network=Network(f08bb357-59fb-44cf-a11e-1eaf17bbe75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d4458e-b3') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46d4458e-b3, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46d4458e-b3, col_values=(('external_ids', {'iface-id': '46d4458e-b33c-4f49-9625-e1ae1c191fb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:8e:dd', 'vm-uuid': 'c14c316b-deba-4835-acb5-7674420fd8d1'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:39 user nova-compute[71482]: INFO os_vif [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8e:dd,bridge_name='br-int',has_traffic_filtering=True,id=46d4458e-b33c-4f49-9625-e1ae1c191fb2,network=Network(f08bb357-59fb-44cf-a11e-1eaf17bbe75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d4458e-b3')
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:20:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] No VIF found with MAC fa:16:3e:49:8e:dd, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:20:40 user nova-compute[71482]: DEBUG nova.network.neutron [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Updated VIF entry in instance network info cache for port 46d4458e-b33c-4f49-9625-e1ae1c191fb2. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:20:40 user nova-compute[71482]: DEBUG nova.network.neutron [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Updating instance_info_cache with network_info: [{"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:20:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-62daccb3-5200-4dc9-9cda-46221628bdda req-85c23360-2882-42d0-bc79-c8017a1262e9 service nova] Releasing lock "refresh_cache-c14c316b-deba-4835-acb5-7674420fd8d1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:20:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received event network-vif-plugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:20:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] Acquiring lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] No waiting events found dispatching network-vif-plugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:20:41 user nova-compute[71482]: WARNING nova.compute.manager [req-c063b72b-b016-4f0c-ac55-ff3c70f09633 req-531901a5-0744-4259-98fd-e1e26ca5ad25 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received unexpected event network-vif-plugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance with vm_state building and task_state spawning.
Apr 12 09:20:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291243.3680568, c14c316b-deba-4835-acb5-7674420fd8d1 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:20:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] VM Resumed (Lifecycle Event)
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:20:43 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Instance spawned successfully.
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:20:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291243.3728502, c14c316b-deba-4835-acb5-7674420fd8d1 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:20:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] VM Started (Lifecycle Event)
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:20:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Took 5.69 seconds to spawn the instance on the hypervisor.
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:20:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received event network-vif-plugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] Acquiring lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] No waiting events found dispatching network-vif-plugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:20:43 user nova-compute[71482]: WARNING nova.compute.manager [req-f507a737-dc02-471c-a413-ae81101f89e9 req-5a48b66d-28c6-47ed-9958-f5504e28ce23 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received unexpected event network-vif-plugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance with vm_state building and task_state spawning.
Apr 12 09:20:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Took 6.54 seconds to build instance.
Apr 12 09:20:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8b258cd7-cbfe-491c-bcc5-616752404f54 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "c14c316b-deba-4835-acb5-7674420fd8d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.635s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:20:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [{"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-4f211820-161b-4bef-b25d-ced137325da1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:20:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:20:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:20:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:20:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:20:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:20:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:20:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:03 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:21:03 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:21:03 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7591MB free_disk=26.178104400634766GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:21:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e442604c-86f4-45e1-9407-1764133852ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 825afa91-cf8c-477a-afbf-40af95b81c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance c14c316b-deba-4835-acb5-7674420fd8d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:12 user nova-compute[71482]: INFO nova.compute.manager [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Unshelving
Apr 12 09:21:12 user nova-compute[71482]: INFO nova.virt.block_device [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Booting with volume dc5375ad-ca3d-4909-a1f0-42c140f9875d at /dev/vdc
Apr 12 09:21:12 user nova-compute[71482]: DEBUG os_brick.utils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe8de6-43cf-4758-bfc1-c92d1e1cc4b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e7236e-54e9-4ea2-bffd-03240d1e1b65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafa2c59-307e-4dd8-b468-9c465754fe9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8054b16f-b6cf-446c-9773-edc091ba6a6a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:21:12 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:21:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4126fe-1a28-417f-b8db-4cd6182e2938]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG os_brick.utils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:21:12 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating existing volume attachment record: 723dd7db-098f-4eba-ad07-763e7482a33c {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:21:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received event network-changed-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Refreshing instance network info cache due to event network-changed-49c0392a-a4e7-4b73-af28-79c87a052cd8. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:21:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] Acquiring lock "refresh_cache-73c2cdd1-9214-4678-91a0-40fdb74403a2" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:21:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] Acquired lock "refresh_cache-73c2cdd1-9214-4678-91a0-40fdb74403a2" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:21:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Refreshing network info cache for port 49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:21:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Updated VIF entry in instance network info cache for port 49c0392a-a4e7-4b73-af28-79c87a052cd8. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:21:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Updating instance_info_cache with network_info: [{"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:21:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e9a109ec-b63f-428f-b44f-371d8bd5f074 req-faefe3ca-b4f1-45b7-9db5-0f21d5ed07bf service nova] Releasing lock "refresh_cache-73c2cdd1-9214-4678-91a0-40fdb74403a2" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:21:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:15 user nova-compute[71482]: INFO nova.compute.manager [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Attaching volume 9310705e-e612-4baf-92ad-00cd29fc54d1 to /dev/vdb
Apr 12 09:21:15 user nova-compute[71482]: DEBUG os_brick.utils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe14480-8dff-4b95-8447-cf3f38bedb89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0fb5ff-e98d-4e58-ba1e-99f5cbf967b4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a57f92d-8a26-4fb6-89ff-a530f46db6af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b1c9fd-7d4b-40b9-8a29-383ac3703307]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:21:16 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac693e-d1aa-45c7-bfa9-84791230dd62]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG os_brick.utils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Updating existing volume attachment record: f4f0fc80-0d2c-4286-aa07-ec81ca474000 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG nova.objects.instance [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'pci_requests' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG nova.objects.instance [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'numa_topology' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:16 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:21:16 user nova-compute[71482]: INFO nova.compute.claims [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Claim successful on node user
Apr 12 09:21:17 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:21:17 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:21:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:17 user nova-compute[71482]: INFO nova.network.neutron [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating port 1cf7a879-f705-467c-af44-2b2d40216cef with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquired lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-changed-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Refreshing instance network info cache due to event network-changed-1cf7a879-f705-467c-af44-2b2d40216cef. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] Acquiring lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating instance_info_cache with network_info: [{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Releasing lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:21:18 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Creating image(s)
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG nova.objects.instance [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] Acquired lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Refreshing network info cache for port 1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "8e188faea5a45dc056d3c888b57f1eb2533270c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8e188faea5a45dc056d3c888b57f1eb2533270c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0.part --force-share --output=json" returned: 0 in 0.157s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:19 user nova-compute[71482]: DEBUG nova.virt.images [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] 62564285-e4f9-4626-a61e-40b78fa203dd was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:21:19 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:21:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0.part /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updated VIF entry in instance network info cache for port 1cf7a879-f705-467c-af44-2b2d40216cef. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:21:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating instance_info_cache with network_info: [{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:21:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4fa39422-68a5-45f3-8d29-df6364319a55 req-3a602955-c86f-49f3-9cef-5ae6ae9d01cc service nova] Releasing lock "refresh_cache-25232386-f51a-434b-9280-c4dd30b55f3d" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:21:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0.part /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0.converted" returned: 0 in 0.626s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8e188faea5a45dc056d3c888b57f1eb2533270c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.765s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0 --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "8e188faea5a45dc056d3c888b57f1eb2533270c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8e188faea5a45dc056d3c888b57f1eb2533270c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoVqGYTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:21:20 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:21:20 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:21:20 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06a7a19-31ec-480a-97cc-45c8ed4c9c74]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:21:20 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0 --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0,backing_fmt=raw /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d173d2-0648-454b-8522-39cc039289f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1] added
Apr 12 09:21:20 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0,backing_fmt=raw /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk 1073741824" returned: 0 in 0.054s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8e188faea5a45dc056d3c888b57f1eb2533270c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[17659ba8-085d-46d9-8e88-8d9d2d984e0a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[701c8a40-a8e4-4a59-a5c3-1781e88b3cc4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoVqGYTM {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IoVqGYTM" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a35aa36-892f-44d9-a4b1-2795c11e5d0b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IoVqGYTM'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ef363f-4cf9-47a9-8550-c10ac8ceddc9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[219cd5f7-fe0f-4d4d-ae7d-22b9389811f6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:20 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:20 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0 --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG nova.objects.instance [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'migration_context' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:20 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Rebasing disk image.
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d37c129-55de-4ebd-b14a-ff79d82fe266]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1, portal: 172.16.0.220,3260]
Apr 12 09:21:20 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1, portal: 172.16.0.220,3260] successful.
Apr 12 09:21:20 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[49923cd7-f618-43be-8ea0-b305c94c392f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b278b7c2-1d31-4853-aa51-796b55c58b5e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:20 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:20 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 -F raw /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4012d0-c49a-45af-aa6d-f3da1815b0cd]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:21:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoVqGYTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:21:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:21:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23433373161653065', 'path': '/dev/sdg'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:21:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433373161653065', 'path': '/dev/sdg'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:21:21 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:21:22 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:21:22 user nova-compute[71482]:   <source dev="/dev/sdg"/>
Apr 12 09:21:22 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:21:22 user nova-compute[71482]:   <serial>9310705e-e612-4baf-92ad-00cd29fc54d1</serial>
Apr 12 09:21:22 user nova-compute[71482]: </disk>
Apr 12 09:21:22 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:21:23 user nova-compute[71482]: INFO nova.compute.manager [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Unrescuing
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquired lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No VIF found with MAC fa:16:3e:d6:6c:59, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a2b59df9-28eb-42d5-8e2b-158c76847a5d tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.730s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 -F raw /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk" returned: 0 in 2.869s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Ensure instance console log exists: /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Start _get_guest_xml network_info=[{"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='d23246a0f2f6286c6ee852c97141f0d9',container_format='bare',created_at=2023-04-12T09:19:20Z,direct_url=<?>,disk_format='qcow2',id=62564285-e4f9-4626-a61e-40b78fa203dd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-325803830-shelved',owner='6ebfa64bb5194b859821a77de6805d2d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T09:19:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '723dd7db-098f-4eba-ad07-763e7482a33c', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRgxfait', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '25232386-f51a-434b-9280-c4dd30b55f3d', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc5375ad-ca3d-4909-a1f0-42c140f9875d', 'serial': 'dc5375ad-ca3d-4909-a1f0-42c140f9875d'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:21:23 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:21:23 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d23246a0f2f6286c6ee852c97141f0d9',container_format='bare',created_at=2023-04-12T09:19:20Z,direct_url=<?>,disk_format='qcow2',id=62564285-e4f9-4626-a61e-40b78fa203dd,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-325803830-shelved',owner='6ebfa64bb5194b859821a77de6805d2d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T09:19:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.objects.instance [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRgxfait', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:21:23 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:21:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:21:23 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:21:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:21:23 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating instance_info_cache with network_info: [{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Releasing lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'flavor' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260" returned: 21 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[386728ad-2dab-45c0-8670-a8f058fb8d67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:21:23 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[675a0482-1ae8-4f96-b889-85a6b6c15d37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d] added
Apr 12 09:21:23 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfaa619-67d6-4d85-a6d3-fe8082e6c4f5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[567f7033-375b-437e-9cf2-8d7eed2d7ab7]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRgxfait {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRgxfait" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08fb8bf-4967-4698-ace8-9b4abc073177]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PRgxfait'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed028aa-3cae-4ffb-a709-63aa3695aed4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e98c68b-9739-4633-a111-5814b6537360]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3884a7f5-549c-4b5c-945d-39205c8c6dc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d, portal: 172.16.0.220,3260]
Apr 12 09:21:24 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d, portal: 172.16.0.220,3260] successful.
Apr 12 09:21:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb87290-0326-4b96-abba-bbf6f00bde2a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2390bbb0-4602-414c-bc2f-371212f4dd35]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:24 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] HCTL ('39', '-', '-', 0) found on session 31 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[529b0ff3-4387-41f8-ba21-fec59a8c7b9f]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Searching for a device in session 31 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRgxfait', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-unplugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-unplugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:24 user nova-compute[71482]: WARNING nova.compute.manager [req-20be7c8f-601a-4c1e-beda-8cb45940eb30 req-9789c934-53e2-44c8-be11-6b56cb8d7cc5 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-unplugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:21:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:24 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Instance destroyed successfully.
Apr 12 09:21:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:25 user nova-compute[71482]: INFO nova.compute.manager [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Terminating instance
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23238343537326463', 'path': '/dev/sdh'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238343537326463', 'path': '/dev/sdh'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325803830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325803830',id=19,image_ref='62564285-e4f9-4626-a61e-40b78fa203dd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-501602451',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-ngwjnp8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member',shelved_at='2023-04-12T09:19:23.655453',shelved_host='user',shelved_image_id='62564285-e4f9-4626-a61e-40b78fa203dd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=25232386-f51a-434b-9280-c4dd30b55f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.objects.instance [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'pci_devices' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:21:25 user nova-compute[71482]:   <uuid>25232386-f51a-434b-9280-c4dd30b55f3d</uuid>
Apr 12 09:21:25 user nova-compute[71482]:   <name>instance-00000013</name>
Apr 12 09:21:25 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:21:25 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:21:25 user nova-compute[71482]:   <metadata>
Apr 12 09:21:25 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:21:25 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:21:25 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-325803830</nova:name>
Apr 12 09:21:25 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:21:23</nova:creationTime>
Apr 12 09:21:25 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:21:25 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:21:25 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:21:25 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:21:25 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:21:25 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:21:25 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:21:25 user nova-compute[71482]:       <nova:owner>
Apr 12 09:21:25 user nova-compute[71482]:         <nova:user uuid="d76daece06a943668e6c1c3c2c57ebaa">tempest-AttachVolumeShelveTestJSON-72439030-project-member</nova:user>
Apr 12 09:21:25 user nova-compute[71482]:         <nova:project uuid="6ebfa64bb5194b859821a77de6805d2d">tempest-AttachVolumeShelveTestJSON-72439030</nova:project>
Apr 12 09:21:25 user nova-compute[71482]:       </nova:owner>
Apr 12 09:21:25 user nova-compute[71482]:       <nova:root type="image" uuid="62564285-e4f9-4626-a61e-40b78fa203dd"/>
Apr 12 09:21:25 user nova-compute[71482]:       <nova:ports>
Apr 12 09:21:25 user nova-compute[71482]:         <nova:port uuid="1cf7a879-f705-467c-af44-2b2d40216cef">
Apr 12 09:21:25 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:21:25 user nova-compute[71482]:         </nova:port>
Apr 12 09:21:25 user nova-compute[71482]:       </nova:ports>
Apr 12 09:21:25 user nova-compute[71482]:     </nova:instance>
Apr 12 09:21:25 user nova-compute[71482]:   </metadata>
Apr 12 09:21:25 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:21:25 user nova-compute[71482]:     <system>
Apr 12 09:21:25 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:21:25 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:21:25 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:21:25 user nova-compute[71482]:       <entry name="serial">25232386-f51a-434b-9280-c4dd30b55f3d</entry>
Apr 12 09:21:25 user nova-compute[71482]:       <entry name="uuid">25232386-f51a-434b-9280-c4dd30b55f3d</entry>
Apr 12 09:21:25 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:21:25 user nova-compute[71482]:     </system>
Apr 12 09:21:25 user nova-compute[71482]:   </sysinfo>
Apr 12 09:21:25 user nova-compute[71482]:   <os>
Apr 12 09:21:25 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:21:25 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:21:25 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:21:25 user nova-compute[71482]:   </os>
Apr 12 09:21:25 user nova-compute[71482]:   <features>
Apr 12 09:21:25 user nova-compute[71482]:     <acpi/>
Apr 12 09:21:25 user nova-compute[71482]:     <apic/>
Apr 12 09:21:25 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:21:25 user nova-compute[71482]:   </features>
Apr 12 09:21:25 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:21:25 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:21:25 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:21:25 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:21:25 user nova-compute[71482]:   </clock>
Apr 12 09:21:25 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:21:25 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:21:25 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:21:25 user nova-compute[71482]:   </cpu>
Apr 12 09:21:25 user nova-compute[71482]:   <devices>
Apr 12 09:21:25 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:21:25 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:21:25 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk"/>
Apr 12 09:21:25 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:21:25 user nova-compute[71482]:     </disk>
Apr 12 09:21:25 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:21:25 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:21:25 user nova-compute[71482]:       <source dev="/dev/sdh"/>
Apr 12 09:21:25 user nova-compute[71482]:       <target dev="vdc" bus="virtio"/>
Apr 12 09:21:25 user nova-compute[71482]:       <serial>dc5375ad-ca3d-4909-a1f0-42c140f9875d</serial>
Apr 12 09:21:25 user nova-compute[71482]:     </disk>
Apr 12 09:21:25 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:21:25 user nova-compute[71482]:       <mac address="fa:16:3e:d5:74:bc"/>
Apr 12 09:21:25 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:21:25 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:21:25 user nova-compute[71482]:       <target dev="tap1cf7a879-f7"/>
Apr 12 09:21:25 user nova-compute[71482]:     </interface>
Apr 12 09:21:25 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:21:25 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/console.log" append="off"/>
Apr 12 09:21:25 user nova-compute[71482]:     </serial>
Apr 12 09:21:25 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:21:25 user nova-compute[71482]:     <video>
Apr 12 09:21:25 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:21:25 user nova-compute[71482]:     </video>
Apr 12 09:21:25 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:21:25 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:21:25 user nova-compute[71482]:     </rng>
Apr 12 09:21:25 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:21:25 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:21:25 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:21:25 user nova-compute[71482]:     </memballoon>
Apr 12 09:21:25 user nova-compute[71482]:   </devices>
Apr 12 09:21:25 user nova-compute[71482]: </domain>
Apr 12 09:21:25 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325803830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325803830',id=19,image_ref='62564285-e4f9-4626-a61e-40b78fa203dd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-501602451',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:17:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-ngwjnp8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member',shelved_at='2023-04-12T09:19:23.655453',shelved_host='user',shelved_image_id='62564285-e4f9-4626-a61e-40b78fa203dd'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:21:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=25232386-f51a-434b-9280-c4dd30b55f3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG os_vif [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cf7a879-f7, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1cf7a879-f7, col_values=(('external_ids', {'iface-id': '1cf7a879-f705-467c-af44-2b2d40216cef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:74:bc', 'vm-uuid': '25232386-f51a-434b-9280-c4dd30b55f3d'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:25 user nova-compute[71482]: INFO os_vif [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7')
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] No VIF found with MAC fa:16:3e:d5:74:bc, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:21:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received event network-changed-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Refreshing instance network info cache due to event network-changed-45389f3c-d497-46bd-bb7e-78f6c977674a. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Acquiring lock "refresh_cache-dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Acquired lock "refresh_cache-dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG nova.network.neutron [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Refreshing network info cache for port 45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:26 user nova-compute[71482]: INFO nova.compute.manager [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Attaching volume f901c201-bf33-4476-af4d-75ec2e081edc to /dev/vdc
Apr 12 09:21:26 user nova-compute[71482]: DEBUG os_brick.utils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d2187b-bc28-4253-96c4-ebc78be0a465]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[30138b6a-d202-4d20-ba0c-91609d4580a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[614f84b1-9058-4e36-b5d6-41c347720f58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7154c7c7-bf0e-4584-8bc8-1335837f2c31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG nova.network.neutron [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Updated VIF entry in instance network info cache for port 45389f3c-d497-46bd-bb7e-78f6c977674a. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG nova.network.neutron [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Updating instance_info_cache with network_info: [{"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Releasing lock "refresh_cache-dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:26 user nova-compute[71482]: WARNING nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:21:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received event network-vif-unplugged-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Acquiring lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] No waiting events found dispatching network-vif-unplugged-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received event network-vif-unplugged-45389f3c-d497-46bd-bb7e-78f6c977674a for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received event network-vif-plugged-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Acquiring lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] No waiting events found dispatching network-vif-plugged-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:27 user nova-compute[71482]: WARNING nova.compute.manager [req-05ddb683-3861-46f0-8676-0ebbf8503758 req-b955a271-df75-4ae7-bdb6-ef2fabb6a586 service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received unexpected event network-vif-plugged-45389f3c-d497-46bd-bb7e-78f6c977674a for instance with vm_state active and task_state deleting.
Apr 12 09:21:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:21:27 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:21:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[842a306a-6dfb-4c81-b178-88baceb00af6]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG os_brick.utils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Updating existing volume attachment record: 53ee52f4-f4ce-4647-ba10-c9757c68baf5 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:21:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Instance destroyed successfully.
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'resources' on Instance uuid dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:19:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-451080542',display_name='tempest-AttachVolumeNegativeTest-server-451080542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-451080542',id=23,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP51TTucuI9vEnyIAeef4Vp7Qq8j+8RA/jR7dkk8rngksIPTjdIVW+QOnQJiPAfRnKEEkjxS/df5PFigO92DmtNDYjq1D17xkh5ij081vpoDIttqa+Y9KL2Mvy4sU65NvQ==',key_name='tempest-keypair-874485369',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-g3aorn55',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:19:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "45389f3c-d497-46bd-bb7e-78f6c977674a", "address": "fa:16:3e:92:4a:a8", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45389f3c-d4", "ovs_interfaceid": "45389f3c-d497-46bd-bb7e-78f6c977674a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=45389f3c-d497-46bd-bb7e-78f6c977674a,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45389f3c-d4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG os_vif [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=45389f3c-d497-46bd-bb7e-78f6c977674a,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45389f3c-d4') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45389f3c-d4, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:27 user nova-compute[71482]: INFO os_vif [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:4a:a8,bridge_name='br-int',has_traffic_filtering=True,id=45389f3c-d497-46bd-bb7e-78f6c977674a,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45389f3c-d4')
Apr 12 09:21:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Deleting instance files /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6_del
Apr 12 09:21:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Deletion of /opt/stack/data/nova/instances/dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6_del complete
Apr 12 09:21:27 user nova-compute[71482]: INFO nova.compute.manager [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Took 2.15 seconds to destroy the instance on the hypervisor.
Apr 12 09:21:27 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:21:27 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:28 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Took 0.96 seconds to deallocate network for instance.
Apr 12 09:21:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-ab3a585d-98b4-4ee1-b228-c9c7275addd4 req-7b43804f-b274-44c1-a17c-30bc20e9ff5c service nova] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Received event network-vif-deleted-45389f3c-d497-46bd-bb7e-78f6c977674a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:28 user nova-compute[71482]: WARNING nova.compute.manager [req-626ff00a-23c2-4b69-b2f2-ba21ae7a0d9e req-70f6e332-b706-4a3d-a5f7-3c12fa0eb470 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:21:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:21:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.535s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:28 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Deleted allocations for instance dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6
Apr 12 09:21:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e38faa6f-16b1-495c-9b76-92cd55a9e65a tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.889s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:30 user nova-compute[71482]: WARNING nova.compute.manager [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] No waiting events found dispatching network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:30 user nova-compute[71482]: WARNING nova.compute.manager [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received unexpected event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] No waiting events found dispatching network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:30 user nova-compute[71482]: WARNING nova.compute.manager [req-b469a381-2361-47f8-84cd-7e668081648d req-fc7fc589-dd77-4250-a139-3f25c513e8a7 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received unexpected event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291290.9639256, 25232386-f51a-434b-9280-c4dd30b55f3d => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:21:30 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] VM Resumed (Lifecycle Event)
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a61d53dd-b3e0-4a65-a503-9d2096fce20f tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:21:30 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance spawned successfully.
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:21:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:21:31 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291290.9642482, 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:21:31 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] VM Resumed (Lifecycle Event)
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291290.9659226, 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:21:31 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] VM Started (Lifecycle Event)
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291290.9695346, 25232386-f51a-434b-9280-c4dd30b55f3d => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:21:31 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] VM Started (Lifecycle Event)
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:21:31 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-002a1b5b-0664-4d82-a79c-29b0da04a6d8 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.007s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgAhLHDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:21:31 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:21:31 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:21:31 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[417b5dac-b4dd-4b58-a32d-8c15e15288b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:21:31 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04bfbec-cce0-4fff-ad29-9144f01a018f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc] added
Apr 12 09:21:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1c82a9-ae22-45e7-b39d-70d2f818a089]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fb2f08-0c77-4120-ba8a-d1cfa4449930]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgAhLHDM {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JgAhLHDM" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f9651a-c64d-456b-b5fd-19db9fa0889f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JgAhLHDM'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d41113a-8fed-4bc1-b0ef-50040591fdd2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8763e1-9e65-48b6-95b5-243ffd3a555b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4da3a2-866e-49a8-8637-b76a1d7a9e01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc, portal: 172.16.0.220,3260]
Apr 12 09:21:31 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc, portal: 172.16.0.220,3260] successful.
Apr 12 09:21:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a5a014-94cf-4f7f-aaca-1f57e5583f26]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd77abd7-164d-400f-8d2d-48e247b9e965]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc (non-flash)
Apr 12 09:21:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:31 user nova-compute[71482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc (non-flash)
Apr 12 09:21:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] HCTL ('40', '-', '-', 0) found on session 32 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:21:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd02b5ee-be14-4481-92f0-e35f65252fff]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:32 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Searching for a device in session 32 and hctl ['40', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:21:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Searching for a device in session 32 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgAhLHDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23739363038333864', 'path': '/dev/sdi'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739363038333864', 'path': '/dev/sdi'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:21:33 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:21:33 user nova-compute[71482]:   <source dev="/dev/sdi"/>
Apr 12 09:21:33 user nova-compute[71482]:   <target dev="vdc" bus="virtio"/>
Apr 12 09:21:33 user nova-compute[71482]:   <serial>f901c201-bf33-4476-af4d-75ec2e081edc</serial>
Apr 12 09:21:33 user nova-compute[71482]: </disk>
Apr 12 09:21:33 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] No VIF found with MAC fa:16:3e:d6:6c:59, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:21:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8bfd9bdd-cadd-40f8-a34d-1f1b50eaf8ef tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.877s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:34 user nova-compute[71482]: INFO nova.compute.manager [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Detaching volume 9310705e-e612-4baf-92ad-00cd29fc54d1
Apr 12 09:21:34 user nova-compute[71482]: INFO nova.virt.block_device [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Attempting to driver detach volume 9310705e-e612-4baf-92ad-00cd29fc54d1 from mountpoint /dev/vdb
Apr 12 09:21:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Attempting to detach device vdb from instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:21:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:21:34 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:21:34 user nova-compute[71482]:   <source dev="/dev/sdg"/>
Apr 12 09:21:34 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:21:34 user nova-compute[71482]:   <serial>9310705e-e612-4baf-92ad-00cd29fc54d1</serial>
Apr 12 09:21:34 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:21:34 user nova-compute[71482]: </disk>
Apr 12 09:21:34 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:21:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully detached device vdb from instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 from the persistent domain config.
Apr 12 09:21:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:21:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:21:34 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:21:34 user nova-compute[71482]:   <source dev="/dev/sdg"/>
Apr 12 09:21:34 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:21:34 user nova-compute[71482]:   <serial>9310705e-e612-4baf-92ad-00cd29fc54d1</serial>
Apr 12 09:21:34 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:21:34 user nova-compute[71482]: </disk>
Apr 12 09:21:34 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681291295.4539087, 73c2cdd1-9214-4678-91a0-40fdb74403a2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:21:35 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully detached device vdb from instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 from the live domain config.
Apr 12 09:21:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IoVqGYTM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:21:35 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acd3f89-6160-489d-8463-c0e19dab40dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:21:35 user nova-compute[71482]: No targets found.
Apr 12 09:21:35 user nova-compute[71482]: iSNS:
Apr 12 09:21:35 user nova-compute[71482]: No targets found.
Apr 12 09:21:35 user nova-compute[71482]: STATIC:
Apr 12 09:21:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc
Apr 12 09:21:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58
Apr 12 09:21:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86
Apr 12 09:21:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1
Apr 12 09:21:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d
Apr 12 09:21:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d
Apr 12 09:21:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:21:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2
Apr 12 09:21:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:35 user nova-compute[71482]: FIRMWARE:
Apr 12 09:21:35 user nova-compute[71482]: No targets found.
Apr 12 09:21:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:21:35 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:21:35 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e698c0-62a8-433d-b6c1-18c419ce6a5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[97996020-2277-48c3-b6e5-f9f45388116d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc (non-flash)
Apr 12 09:21:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:35 user nova-compute[71482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc (non-flash)
Apr 12 09:21:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c1c91b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1'): ({'sdg'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Removing single pathed devices sdg {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8ec268-5ba4-4277-a37e-5d483b63ce6d]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[798b9feb-aa44-4902-ad13-05cc5d06c230]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flushing IO for device /dev/sdg {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c52923-2908-455c-a4a4-16d57657cfee]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e96c43-7ce8-460d-a2c7-a54e04f59181]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] SCSI volumes sdg have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[777c5ab8-38c7-470b-a83b-cc820fed57e6]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[941f7f81-7051-4f49-b141-4698479bacbf]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1, portal: 172.16.0.220,3260]
Apr 12 09:21:35 user nova-compute[71482]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1, portal: 172.16.0.220,3260] successful.
Apr 12 09:21:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9310705e-e612-4baf-92ad-00cd29fc54d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[838e6be9-0d78-4b0b-86b4-a3258a4bb3c3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== disconnect_volume: return (359ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:21:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:21:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e605c87c-8dc6-4519-8a98-629133e78f38 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.783s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:37 user nova-compute[71482]: INFO nova.compute.manager [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Detaching volume f901c201-bf33-4476-af4d-75ec2e081edc
Apr 12 09:21:37 user nova-compute[71482]: INFO nova.virt.block_device [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Attempting to driver detach volume f901c201-bf33-4476-af4d-75ec2e081edc from mountpoint /dev/vdc
Apr 12 09:21:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Attempting to detach device vdc from instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:21:37 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:21:37 user nova-compute[71482]:   <source dev="/dev/sdi"/>
Apr 12 09:21:37 user nova-compute[71482]:   <target dev="vdc" bus="virtio"/>
Apr 12 09:21:37 user nova-compute[71482]:   <serial>f901c201-bf33-4476-af4d-75ec2e081edc</serial>
Apr 12 09:21:37 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 09:21:37 user nova-compute[71482]: </disk>
Apr 12 09:21:37 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:21:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully detached device vdc from instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 from the persistent domain config.
Apr 12 09:21:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:21:37 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:21:37 user nova-compute[71482]:   <source dev="/dev/sdi"/>
Apr 12 09:21:37 user nova-compute[71482]:   <target dev="vdc" bus="virtio"/>
Apr 12 09:21:37 user nova-compute[71482]:   <serial>f901c201-bf33-4476-af4d-75ec2e081edc</serial>
Apr 12 09:21:37 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 12 09:21:37 user nova-compute[71482]: </disk>
Apr 12 09:21:37 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681291297.8746119, 73c2cdd1-9214-4678-91a0-40fdb74403a2 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:21:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully detached device vdc from instance 73c2cdd1-9214-4678-91a0-40fdb74403a2 from the live domain config.
Apr 12 09:21:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JgAhLHDM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:21:37 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[92865bb8-87bf-4881-82a3-6477bbe8e314]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:21:37 user nova-compute[71482]: No targets found.
Apr 12 09:21:37 user nova-compute[71482]: iSNS:
Apr 12 09:21:37 user nova-compute[71482]: No targets found.
Apr 12 09:21:37 user nova-compute[71482]: STATIC:
Apr 12 09:21:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc
Apr 12 09:21:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58
Apr 12 09:21:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86
Apr 12 09:21:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d
Apr 12 09:21:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d
Apr 12 09:21:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:21:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2
Apr 12 09:21:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:21:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:21:37 user nova-compute[71482]: FIRMWARE:
Apr 12 09:21:37 user nova-compute[71482]: No targets found.
Apr 12 09:21:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:21:37 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:21:37 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a81b60-2b8a-4935-a70c-c73af9d9c9b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0fa065-5ab4-47d3-8306-3c0888c89d04]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc (non-flash)
Apr 12 09:21:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:21:37 user nova-compute[71482]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc (non-flash)
Apr 12 09:21:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c1672e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc'): ({'sdi'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Removing single pathed devices sdi {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:21:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d323d-694b-4676-b4d9-52a3cc4fef2e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48b6073-43e1-49e3-9d1b-77743769827f]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Flushing IO for device /dev/sdi {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba28cba-1164-4e2a-ba8c-26cefab8d431]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b4deef-1438-43d4-8569-fa3d5e4bb69f]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] SCSI volumes sdi have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce433fcb-12d6-49ce-a474-1b5246988b6e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29f0afa-c39a-40a3-8cc0-e235290e8bae]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc, portal: 172.16.0.220,3260]
Apr 12 09:21:38 user nova-compute[71482]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc, portal: 172.16.0.220,3260] successful.
Apr 12 09:21:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f901c201-bf33-4476-af4d-75ec2e081edc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[600d532e-112f-4074-ab28-31cb39eb4826]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] <== disconnect_volume: return (347ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:21:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:39 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'flavor' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8232e035-7860-4360-b9e5-604d7e9554b6 tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.710s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:39 user nova-compute[71482]: INFO nova.compute.manager [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Terminating instance
Apr 12 09:21:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received event network-vif-unplugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] No waiting events found dispatching network-vif-unplugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-23ad219c-9a7c-43bb-af6f-64f704fe35fb req-91c5dc02-ad5f-48b5-98b5-9235db1e42a5 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received event network-vif-unplugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Instance destroyed successfully.
Apr 12 09:21:40 user nova-compute[71482]: DEBUG nova.objects.instance [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lazy-loading 'resources' on Instance uuid 73c2cdd1-9214-4678-91a0-40fdb74403a2 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:19:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1998611823',display_name='tempest-AttachVolumeTestJSON-server-1998611823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1998611823',id=22,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnIl9SCgl+gRiGEuXiMy4XMrc+rm4KKN6tg61KVSaw3G+aWg0i33luIdnCph1+ecByAmzSyxMPbfHh84em5kfq5+K4QbOBA63ZAz57V7w3I+7WSQCtggno/5IECnki4VA==',key_name='tempest-keypair-1500886200',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:19:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23e6ce78ce3d4eb5b4bbb307665c3670',ramdisk_id='',reservation_id='r-bljmq1uq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1252670961',owner_user_name='tempest-AttachVolumeTestJSON-1252670961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:19:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a3731bf575c44d89211709cb07060b7',uuid=73c2cdd1-9214-4678-91a0-40fdb74403a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converting VIF {"id": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "address": "fa:16:3e:d6:6c:59", "network": {"id": "61984664-d574-4fe6-bed1-a2eb1a52b843", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2133946918-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e6ce78ce3d4eb5b4bbb307665c3670", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49c0392a-a4", "ovs_interfaceid": "49c0392a-a4e7-4b73-af28-79c87a052cd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6c:59,bridge_name='br-int',has_traffic_filtering=True,id=49c0392a-a4e7-4b73-af28-79c87a052cd8,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c0392a-a4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG os_vif [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6c:59,bridge_name='br-int',has_traffic_filtering=True,id=49c0392a-a4e7-4b73-af28-79c87a052cd8,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c0392a-a4') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49c0392a-a4, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:40 user nova-compute[71482]: INFO os_vif [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:6c:59,bridge_name='br-int',has_traffic_filtering=True,id=49c0392a-a4e7-4b73-af28-79c87a052cd8,network=Network(61984664-d574-4fe6-bed1-a2eb1a52b843),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49c0392a-a4')
Apr 12 09:21:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Deleting instance files /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2_del
Apr 12 09:21:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Deletion of /opt/stack/data/nova/instances/73c2cdd1-9214-4678-91a0-40fdb74403a2_del complete
Apr 12 09:21:40 user nova-compute[71482]: INFO nova.compute.manager [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 09:21:40 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:21:40 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:21:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:41 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:21:41 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Took 0.84 seconds to deallocate network for instance.
Apr 12 09:21:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:42 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291287.0239716, dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:21:42 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] VM Stopped (Lifecycle Event)
Apr 12 09:21:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-6d49bfa6-85f2-4acd-9909-7b668c14a27f None None] [instance: dfde779c-c85b-4cf8-a6c2-7dc9d85e99a6] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:21:42 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:21:42 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:21:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:42 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Deleted allocations for instance 73c2cdd1-9214-4678-91a0-40fdb74403a2
Apr 12 09:21:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-59aad504-5ba7-49b8-b901-6bc623f7a7ea tempest-AttachVolumeTestJSON-1252670961 tempest-AttachVolumeTestJSON-1252670961-project-member] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.288s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received event network-vif-plugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] Acquiring lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:21:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:21:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] Lock "73c2cdd1-9214-4678-91a0-40fdb74403a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:21:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] No waiting events found dispatching network-vif-plugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:21:42 user nova-compute[71482]: WARNING nova.compute.manager [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received unexpected event network-vif-plugged-49c0392a-a4e7-4b73-af28-79c87a052cd8 for instance with vm_state deleted and task_state None.
Apr 12 09:21:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-0b63bea4-0d8f-4d27-b3da-c4c48681ba69 req-5c4f1e9a-334e-494f-8be1-2e4a58285e18 service nova] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Received event network-vif-deleted-49c0392a-a4e7-4b73-af28-79c87a052cd8 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:21:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:21:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:21:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:21:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:21:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:21:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:21:50 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid a569c652-6b15-4244-b011-1d09fbdd4281 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:21:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:51 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updating instance_info_cache with network_info: [{"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:21:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:21:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:21:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:21:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:21:51 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:21:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:21:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:21:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:21:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:21:55 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291300.7511673, 73c2cdd1-9214-4678-91a0-40fdb74403a2 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:21:55 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] VM Stopped (Lifecycle Event)
Apr 12 09:21:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-5fec3df0-d5e2-4dc0-a677-16e7edb7c112 None None] [instance: 73c2cdd1-9214-4678-91a0-40fdb74403a2] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:21:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:21:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:21:59 user nova-compute[71482]: INFO nova.compute.manager [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Rescuing
Apr 12 09:21:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:21:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquired lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:21:59 user nova-compute[71482]: DEBUG nova.network.neutron [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:21:59 user nova-compute[71482]: DEBUG nova.network.neutron [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Updating instance_info_cache with network_info: [{"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:21:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Releasing lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG nova.compute.manager [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG nova.compute.manager [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:00 user nova-compute[71482]: WARNING nova.compute.manager [req-9b1b3644-9ab5-4bea-bcee-b5ba5f86a876 req-266fccd2-0122-4653-ae34-b0f974cefe18 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state active and task_state rescuing.
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Instance destroyed successfully.
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Attempting a stable device rescue
Apr 12 09:22:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71482) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Instance directory exists: not creating {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 09:22:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Creating image(s)
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "/opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "/opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "/opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'trusted_certs' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "9113e5bfa02931a53739ad35d534f6aede6cf31f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "9113e5bfa02931a53739ad35d534f6aede6cf31f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.600s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f.part --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG nova.virt.images [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] 8715348a-f9cd-4895-99e4-cf9a27970818 was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f.part /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f.part /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f.converted" returned: 0 in 0.254s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f.converted --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "9113e5bfa02931a53739ad35d534f6aede6cf31f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.200s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "9113e5bfa02931a53739ad35d534f6aede6cf31f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "9113e5bfa02931a53739ad35d534f6aede6cf31f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f --force-share --output=json" returned: 0 in 0.170s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f,backing_fmt=raw /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f,backing_fmt=raw /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue" returned: 0 in 0.047s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "9113e5bfa02931a53739ad35d534f6aede6cf31f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'migration_context' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Start _get_guest_xml network_info=[{"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "vif_mac": "fa:16:3e:70:ac:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8715348a-f9cd-4895-99e4-cf9a27970818', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '205ce8fe-d96a-4270-b4b7-fc3c366450bd', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMQfOprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '825afa91-cf8c-477a-afbf-40af95b81c76', 'attached_at': '', 'detached_at': '', 'volume_id': '22ce6dbc-4a22-4480-8874-e107b53f518d', 'serial': '22ce6dbc-4a22-4480-8874-e107b53f518d'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'resources' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:02 user nova-compute[71482]: WARNING nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state active and task_state rescuing.
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:02 user nova-compute[71482]: WARNING nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state active and task_state rescuing.
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:02 user nova-compute[71482]: WARNING nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state active and task_state rescuing.
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:02 user nova-compute[71482]: WARNING nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state active and task_state rescuing.
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:02 user nova-compute[71482]: WARNING nova.compute.manager [req-afa25310-f6e1-4e6e-b89d-b1ce6024f5d4 req-211248ff-247f-422f-9580-639eecf243cb service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state active and task_state rescuing.
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'numa_topology' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:22:02 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'vcpu_model' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMQfOprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:22:02 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:22:02 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:22:02 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[642fa0f4-0112-4772-b933-db3cb1d35639]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nMQfOprs\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 12 09:22:02 user nova-compute[71482]: node.name = iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d
Apr 12 09:22:02 user nova-compute[71482]: node.tpgt = -1
Apr 12 09:22:02 user nova-compute[71482]: node.startup = automatic
Apr 12 09:22:02 user nova-compute[71482]: node.leading_login = No
Apr 12 09:22:02 user nova-compute[71482]: iface.iscsi_ifacename = default
Apr 12 09:22:02 user nova-compute[71482]: iface.net_ifacename = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.ipaddress = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.prefix_len = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.hwaddress = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.transport_name = tcp
Apr 12 09:22:02 user nova-compute[71482]: iface.initiatorname = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.state = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.vlan_id = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.vlan_priority = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.vlan_state = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.iface_num = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.mtu = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.port = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.bootproto = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.subnet_mask = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.gateway = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.dhcp_alt_client_id_state = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.dhcp_alt_client_id = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.dhcp_dns = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.dhcp_learn_iqn = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.dhcp_req_vendor_id_state = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.dhcp_vendor_id_state = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.dhcp_vendor_id = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.dhcp_slp_da = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.fragmentation = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.gratuitous_arp = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.incoming_forwarding = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.tos_state = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.tos = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.ttl = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.delayed_ack = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.tcp_nagle = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.tcp_wsf_state = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.tcp_wsf = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.tcp_timer_scale = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.tcp_timestamp = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.redirect = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.def_task_mgmt_timeout = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.header_digest = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.data_digest = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.immediate_data = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.initial_r2t = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.data_seq_inorder = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.data_pdu_inorder = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.erl = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.max_receive_data_len = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.first_burst_len = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.max_outstanding_r2t = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.max_burst_len = 0
Apr 12 09:22:02 user nova-compute[71482]: iface.chap_auth = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.bidi_chap = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.strict_login_compliance = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.discovery_auth = <empty>
Apr 12 09:22:02 user nova-compute[71482]: iface.discovery_logout = <empty>
Apr 12 09:22:02 user nova-compute[71482]: node.discovery_address = <empty>
Apr 12 09:22:02 user nova-compute[71482]: node.discovery_port = 0
Apr 12 09:22:02 user nova-compute[71482]: node.discovery_type = static
Apr 12 09:22:02 user nova-compute[71482]: node.session.initial_cmdsn = 0
Apr 12 09:22:02 user nova-compute[71482]: node.session.initial_login_retry_max = 8
Apr 12 09:22:02 user nova-compute[71482]: node.session.xmit_thread_priority = -20
Apr 12 09:22:02 user nova-compute[71482]: node.session.cmds_max = 128
Apr 12 09:22:02 user nova-compute[71482]: node.session.queue_depth = 32
Apr 12 09:22:02 user nova-compute[71482]: node.session.nr_sessions = 1
Apr 12 09:22:02 user nova-compute[71482]: node.session.auth.authmethod = CHAP
Apr 12 09:22:02 user nova-compute[71482]: node.session.auth.username = nMQfOprs
Apr 12 09:22:02 user nova-compute[71482]: node.session.auth.password = ***
Apr 12 09:22:02 user nova-compute[71482]: node.session.auth.username_in = <empty>
Apr 12 09:22:02 user nova-compute[71482]: node.session.auth.password_in = <empty>
Apr 12 09:22:02 user nova-compute[71482]: node.session.auth.chap_algs = MD5
Apr 12 09:22:02 user nova-compute[71482]: node.session.timeo.replacement_timeout = 120
Apr 12 09:22:02 user nova-compute[71482]: node.session.err_timeo.abort_timeout = 15
Apr 12 09:22:02 user nova-compute[71482]: node.session.err_timeo.lu_reset_timeout = 30
Apr 12 09:22:02 user nova-compute[71482]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 12 09:22:02 user nova-compute[71482]: node.session.err_timeo.host_reset_timeout = 60
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.FastAbort = Yes
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.InitialR2T = No
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.ImmediateData = Yes
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.FirstBurstLength = 262144
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.MaxBurstLength = 16776192
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.DefaultTime2Retain = 0
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.DefaultTime2Wait = 2
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.MaxConnections = 1
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 12 09:22:02 user nova-compute[71482]: node.session.iscsi.ERL = 0
Apr 12 09:22:02 user nova-compute[71482]: node.session.scan = manual
Apr 12 09:22:02 user nova-compute[71482]: node.session.reopen_max = 0
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].address = 172.16.0.220
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].port = 3260
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].startup = manual
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].tcp.window_size = 524288
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].tcp.type_of_service = 0
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].timeo.logout_timeout = 15
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].timeo.login_timeout = 15
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].timeo.auth_timeout = 45
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].timeo.noop_out_interval = 5
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].timeo.noop_out_timeout = 5
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].iscsi.HeaderDigest = None
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].iscsi.DataDigest = None
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].iscsi.IFMarker = No
Apr 12 09:22:02 user nova-compute[71482]: node.conn[0].iscsi.OFMarker = No
Apr 12 09:22:02 user nova-compute[71482]: # END RECORD
Apr 12 09:22:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[48683878-b8df-403d-b4f9-9fba34bcd9f2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedfabfe-5633-436a-b2de-d0d19b7c2c1b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMQfOprs {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nMQfOprs" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c728df7e-4cf6-45e2-b9e1-3b3d40bece07]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nMQfOprs'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e233e50-337b-4869-92ed-f7602d0a9949]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d64f164-7349-49db-93da-11b525735b56]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:22:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:22:02 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:22:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] HCTL ('37', '0', '0', 0) found on session 29 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dfba7c-c7de-4608-b4d3-70b922e26a9c]: (4, ('0 0 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Searching for a device in session 29 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMQfOprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.235s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] <== connect_volume: return (236ms) {'type': 'block', 'scsi_wwn': '23933636138373835', 'path': '/dev/sdf'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933636138373835', 'path': '/dev/sdf'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1533143626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1533143626',id=24,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:20:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-ob0dtmdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:20:25Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=825afa91-cf8c-477a-afbf-40af95b81c76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "vif_mac": "fa:16:3e:70:ac:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "vif_mac": "fa:16:3e:70:ac:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:ac:21,bridge_name='br-int',has_traffic_filtering=True,id=99f71fe3-cfc5-48aa-99e5-7b826f7a9732,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f71fe3-cf') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'pci_devices' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:22:02 user nova-compute[71482]:   <uuid>825afa91-cf8c-477a-afbf-40af95b81c76</uuid>
Apr 12 09:22:02 user nova-compute[71482]:   <name>instance-00000018</name>
Apr 12 09:22:02 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:22:02 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:22:02 user nova-compute[71482]:   <metadata>
Apr 12 09:22:02 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:22:02 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:22:02 user nova-compute[71482]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1533143626</nova:name>
Apr 12 09:22:02 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:22:02</nova:creationTime>
Apr 12 09:22:02 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:22:02 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:22:02 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:22:02 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:22:02 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:22:02 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:22:02 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:22:02 user nova-compute[71482]:       <nova:owner>
Apr 12 09:22:02 user nova-compute[71482]:         <nova:user uuid="cc51704e74b045ad9733a43aec982390">tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member</nova:user>
Apr 12 09:22:02 user nova-compute[71482]:         <nova:project uuid="a6ce4a0f4dad40c18fd8a83470c15f05">tempest-ServerBootFromVolumeStableRescueTest-1244466684</nova:project>
Apr 12 09:22:02 user nova-compute[71482]:       </nova:owner>
Apr 12 09:22:02 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:22:02 user nova-compute[71482]:       <nova:ports>
Apr 12 09:22:02 user nova-compute[71482]:         <nova:port uuid="99f71fe3-cfc5-48aa-99e5-7b826f7a9732">
Apr 12 09:22:02 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 09:22:02 user nova-compute[71482]:         </nova:port>
Apr 12 09:22:02 user nova-compute[71482]:       </nova:ports>
Apr 12 09:22:02 user nova-compute[71482]:     </nova:instance>
Apr 12 09:22:02 user nova-compute[71482]:   </metadata>
Apr 12 09:22:02 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:22:02 user nova-compute[71482]:     <system>
Apr 12 09:22:02 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:22:02 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:22:02 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:22:02 user nova-compute[71482]:       <entry name="serial">825afa91-cf8c-477a-afbf-40af95b81c76</entry>
Apr 12 09:22:02 user nova-compute[71482]:       <entry name="uuid">825afa91-cf8c-477a-afbf-40af95b81c76</entry>
Apr 12 09:22:02 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:22:02 user nova-compute[71482]:     </system>
Apr 12 09:22:02 user nova-compute[71482]:   </sysinfo>
Apr 12 09:22:02 user nova-compute[71482]:   <os>
Apr 12 09:22:02 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:22:02 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:22:02 user nova-compute[71482]:   </os>
Apr 12 09:22:02 user nova-compute[71482]:   <features>
Apr 12 09:22:02 user nova-compute[71482]:     <acpi/>
Apr 12 09:22:02 user nova-compute[71482]:     <apic/>
Apr 12 09:22:02 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:22:02 user nova-compute[71482]:   </features>
Apr 12 09:22:02 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:22:02 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:22:02 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:22:02 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:22:02 user nova-compute[71482]:   </clock>
Apr 12 09:22:02 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:22:02 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:22:02 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:22:02 user nova-compute[71482]:   </cpu>
Apr 12 09:22:02 user nova-compute[71482]:   <devices>
Apr 12 09:22:02 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:22:02 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:22:02 user nova-compute[71482]:       <source dev="/dev/sdf"/>
Apr 12 09:22:02 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:22:02 user nova-compute[71482]:       <serial>22ce6dbc-4a22-4480-8874-e107b53f518d</serial>
Apr 12 09:22:02 user nova-compute[71482]:     </disk>
Apr 12 09:22:02 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:22:02 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:22:02 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue"/>
Apr 12 09:22:02 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:22:02 user nova-compute[71482]:       <boot order="1"/>
Apr 12 09:22:02 user nova-compute[71482]:     </disk>
Apr 12 09:22:02 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:22:02 user nova-compute[71482]:       <mac address="fa:16:3e:70:ac:21"/>
Apr 12 09:22:02 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:22:02 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:22:02 user nova-compute[71482]:       <target dev="tap99f71fe3-cf"/>
Apr 12 09:22:02 user nova-compute[71482]:     </interface>
Apr 12 09:22:02 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:22:02 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/console.log" append="off"/>
Apr 12 09:22:02 user nova-compute[71482]:     </serial>
Apr 12 09:22:02 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:22:02 user nova-compute[71482]:     <video>
Apr 12 09:22:02 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:22:02 user nova-compute[71482]:     </video>
Apr 12 09:22:02 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:22:02 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:22:02 user nova-compute[71482]:     </rng>
Apr 12 09:22:02 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:22:02 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:22:02 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:22:02 user nova-compute[71482]:     </memballoon>
Apr 12 09:22:02 user nova-compute[71482]:   </devices>
Apr 12 09:22:02 user nova-compute[71482]: </domain>
Apr 12 09:22:02 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:22:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Instance destroyed successfully.
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] No VIF found with MAC fa:16:3e:70:ac:21, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:22:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:22:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:04 user nova-compute[71482]: WARNING nova.compute.manager [req-f7136ea0-bc8d-41d2-b52b-bcb3e909ef7c req-ea5bec48-1971-42ce-a73f-cd3a8d95589f service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state active and task_state rescuing.
Apr 12 09:22:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue --force-share --output=json" returned: 0 in 0.127s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.127s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 825afa91-cf8c-477a-afbf-40af95b81c76 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291326.2901423, 825afa91-cf8c-477a-afbf-40af95b81c76 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:22:06 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] VM Resumed (Lifecycle Event)
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:06 user nova-compute[71482]: WARNING nova.compute.manager [req-cd772d5f-b621-46de-9477-46430c15d1ac req-7a499864-eafb-4d09-a97a-b57063eae089 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state active and task_state rescuing.
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f8ab7086-efd0-4658-95e4-a633343f5a19 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:22:06 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:22:06 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7824MB free_disk=26.215476989746094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:22:06 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291326.29153, 825afa91-cf8c-477a-afbf-40af95b81c76 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:22:06 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] VM Started (Lifecycle Event)
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e442604c-86f4-45e1-9407-1764133852ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4f211820-161b-4bef-b25d-ced137325da1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 825afa91-cf8c-477a-afbf-40af95b81c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance c14c316b-deba-4835-acb5-7674420fd8d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 25232386-f51a-434b-9280-c4dd30b55f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:22:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:22:07 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:22:07 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:22:07 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:22:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:16 user nova-compute[71482]: INFO nova.compute.manager [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Detaching volume 85f0b6fa-1590-4f2f-a26b-e7a3e236ea86
Apr 12 09:22:16 user nova-compute[71482]: INFO nova.virt.block_device [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Attempting to driver detach volume 85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 from mountpoint /dev/vdb
Apr 12 09:22:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Attempting to detach device vdb from instance 9691009c-8aca-4347-8e46-c5bdda13aa3d from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:22:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:22:16 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:22:16 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:22:16 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:22:16 user nova-compute[71482]:   <serial>85f0b6fa-1590-4f2f-a26b-e7a3e236ea86</serial>
Apr 12 09:22:16 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:22:16 user nova-compute[71482]: </disk>
Apr 12 09:22:16 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:22:16 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully detached device vdb from instance 9691009c-8aca-4347-8e46-c5bdda13aa3d from the persistent domain config.
Apr 12 09:22:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9691009c-8aca-4347-8e46-c5bdda13aa3d from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:22:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:22:16 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:22:16 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:22:16 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:22:16 user nova-compute[71482]:   <serial>85f0b6fa-1590-4f2f-a26b-e7a3e236ea86</serial>
Apr 12 09:22:16 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:22:16 user nova-compute[71482]: </disk>
Apr 12 09:22:16 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681291337.048645, 9691009c-8aca-4347-8e46-c5bdda13aa3d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9691009c-8aca-4347-8e46-c5bdda13aa3d {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:22:17 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully detached device vdb from instance 9691009c-8aca-4347-8e46-c5bdda13aa3d from the live domain config.
Apr 12 09:22:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dlqBRPem', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:22:17 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a34d457-d0a8-4ce5-880b-04b6b520dac5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:22:17 user nova-compute[71482]: No targets found.
Apr 12 09:22:17 user nova-compute[71482]: iSNS:
Apr 12 09:22:17 user nova-compute[71482]: No targets found.
Apr 12 09:22:17 user nova-compute[71482]: STATIC:
Apr 12 09:22:17 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58
Apr 12 09:22:17 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:17 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:17 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86
Apr 12 09:22:17 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:17 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:17 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d
Apr 12 09:22:17 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:17 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:17 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d
Apr 12 09:22:17 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:17 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:17 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:22:17 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:17 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:17 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2
Apr 12 09:22:17 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:17 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:17 user nova-compute[71482]: FIRMWARE:
Apr 12 09:22:17 user nova-compute[71482]: No targets found.
Apr 12 09:22:17 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:22:17 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:22:17 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb5ff4e-316c-4f50-96c2-3530ffdb5a91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dc2234-2225-499f-9341-3e1ef493df8a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:22:17 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:22:17 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:22:17 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c22ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e18792c-0386-4261-a361-2d3cd1af8065]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6e5fa7-0abd-4556-bb4c-a5a72e241070]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[579ac9f8-2339-4993-ab58-68aeb9b7a597]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a772026-25d9-4217-994c-29aab5fd6fed]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[32338325-7b80-479f-909f-195e0576e5df]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7895f3ce-b340-4627-92d3-d64a921513cf]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86, portal: 172.16.0.220,3260]
Apr 12 09:22:17 user nova-compute[71482]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86, portal: 172.16.0.220,3260] successful.
Apr 12 09:22:17 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85f0b6fa-1590-4f2f-a26b-e7a3e236ea86 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2671713b-4a42-49b0-a6f4-e406a0b7bfd1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] <== disconnect_volume: return (346ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:22:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:22:18 user nova-compute[71482]: DEBUG nova.objects.instance [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'flavor' on Instance uuid 9691009c-8aca-4347-8e46-c5bdda13aa3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:22:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-47f88ae2-ea20-4d36-9588-fc53261ab25c tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.786s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:23 user nova-compute[71482]: INFO nova.compute.manager [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Terminating instance
Apr 12 09:22:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-efdd7612-125f-45a4-8374-796bedfad553 req-28a96775-3de8-4001-98dc-1d33879e5a9a service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-unplugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:22:24 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Instance destroyed successfully.
Apr 12 09:22:24 user nova-compute[71482]: DEBUG nova.objects.instance [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'resources' on Instance uuid 4f211820-161b-4bef-b25d-ced137325da1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-260276984',display_name='tempest-ServerActionsTestJSON-server-1204181922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-260276984',id=3,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-2mu2gkym',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=4f211820-161b-4bef-b25d-ced137325da1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "address": "fa:16:3e:9b:4e:53", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc64c2a8-53", "ovs_interfaceid": "dc64c2a8-533c-40df-b88e-c059cb9cda89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_vif [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc64c2a8-53, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:24 user nova-compute[71482]: INFO os_vif [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:4e:53,bridge_name='br-int',has_traffic_filtering=True,id=dc64c2a8-533c-40df-b88e-c059cb9cda89,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc64c2a8-53')
Apr 12 09:22:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwjLxYMF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:22:24 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a86224-d2da-4fa5-9a16-e87643461d07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:22:24 user nova-compute[71482]: No targets found.
Apr 12 09:22:24 user nova-compute[71482]: iSNS:
Apr 12 09:22:24 user nova-compute[71482]: No targets found.
Apr 12 09:22:24 user nova-compute[71482]: STATIC:
Apr 12 09:22:24 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58
Apr 12 09:22:24 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:24 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:24 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d
Apr 12 09:22:24 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:24 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:24 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d
Apr 12 09:22:24 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:24 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:24 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:22:24 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:24 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:24 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2
Apr 12 09:22:24 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:22:24 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:22:24 user nova-compute[71482]: FIRMWARE:
Apr 12 09:22:24 user nova-compute[71482]: No targets found.
Apr 12 09:22:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:22:24 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:22:24 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb2aa4c-b288-4d90-ac34-bd635657715d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9c9f10-bf36-406c-b1ed-63a72d528b32]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:22:24 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:22:24 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:22:24 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:22:24 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:22:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:22:24 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:22:24 user nova-compute[71482]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 (non-flash)
Apr 12 09:22:24 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:22:24 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:22:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c164ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58'): ({'sdd'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Removing single pathed devices sdd {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ee409-8c22-4fb3-9c2d-e96e2d082638]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5e8769-7dbf-481d-a928-2e910c6390c1]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flushing IO for device /dev/sdd {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ac0e79-4bd7-4e47-acc9-0224a9a6e9b9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e45837-4dde-459b-a514-5542ad704107]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[27525ea0-1b5d-4949-8480-12fc3eee3190]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3e7650-2f99-46f8-92a7-aa0ae55318e9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260]
Apr 12 09:22:25 user nova-compute[71482]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58, portal: 172.16.0.220,3260] successful.
Apr 12 09:22:25 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d6b141c-5f82-4aed-b319-8579a78c6c58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[81203096-add8-4a90-aaca-93ee57df0cb3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== disconnect_volume: return (421ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:22:25 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Deleting instance files /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1_del
Apr 12 09:22:25 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Deletion of /opt/stack/data/nova/instances/4f211820-161b-4bef-b25d-ced137325da1_del complete
Apr 12 09:22:25 user nova-compute[71482]: INFO nova.compute.manager [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Took 1.39 seconds to destroy the instance on the hypervisor.
Apr 12 09:22:25 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:22:25 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:22:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] Acquiring lock "4f211820-161b-4bef-b25d-ced137325da1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] Lock "4f211820-161b-4bef-b25d-ced137325da1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] No waiting events found dispatching network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:26 user nova-compute[71482]: WARNING nova.compute.manager [req-e252c210-ddf8-488e-884e-0c14d81485fb req-d2880d93-85f1-452d-bc9d-8f9a372e797e service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received unexpected event network-vif-plugged-dc64c2a8-533c-40df-b88e-c059cb9cda89 for instance with vm_state active and task_state deleting.
Apr 12 09:22:26 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:22:26 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Took 1.03 seconds to deallocate network for instance.
Apr 12 09:22:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-5174a05d-b578-4fb7-bad4-3431b576f56b req-e194b842-95ed-4ea6-a4fd-aaaff29f47ea service nova] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Received event network-vif-deleted-dc64c2a8-533c-40df-b88e-c059cb9cda89 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:27 user nova-compute[71482]: INFO nova.compute.manager [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Took 0.79 seconds to detach 1 volumes for instance.
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "c14c316b-deba-4835-acb5-7674420fd8d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "c14c316b-deba-4835-acb5-7674420fd8d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:27 user nova-compute[71482]: INFO nova.compute.manager [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Terminating instance
Apr 12 09:22:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:27 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Deleted allocations for instance 4f211820-161b-4bef-b25d-ced137325da1
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1cab8d7-2988-46ed-a0c8-bb1c3827a783 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "4f211820-161b-4bef-b25d-ced137325da1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.753s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Instance destroyed successfully.
Apr 12 09:22:27 user nova-compute[71482]: DEBUG nova.objects.instance [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lazy-loading 'resources' on Instance uuid c14c316b-deba-4835-acb5-7674420fd8d1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:20:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-197490685',display_name='tempest-VolumesNegativeTest-instance-197490685',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-197490685',id=25,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:20:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c26312b501fe493389501c331ebbc5d0',ramdisk_id='',reservation_id='r-dw13mf5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1969108914',owner_user_name='tempest-VolumesNegativeTest-1969108914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:20:44Z,user_data=None,user_id='1e26e536926043d8add1c2672f965e70',uuid=c14c316b-deba-4835-acb5-7674420fd8d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Converting VIF {"id": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "address": "fa:16:3e:49:8e:dd", "network": {"id": "f08bb357-59fb-44cf-a11e-1eaf17bbe75c", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.230", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "108bed9c8ab843b8aa66c29b85b26d87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46d4458e-b3", "ovs_interfaceid": "46d4458e-b33c-4f49-9625-e1ae1c191fb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:8e:dd,bridge_name='br-int',has_traffic_filtering=True,id=46d4458e-b33c-4f49-9625-e1ae1c191fb2,network=Network(f08bb357-59fb-44cf-a11e-1eaf17bbe75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d4458e-b3') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG os_vif [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8e:dd,bridge_name='br-int',has_traffic_filtering=True,id=46d4458e-b33c-4f49-9625-e1ae1c191fb2,network=Network(f08bb357-59fb-44cf-a11e-1eaf17bbe75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d4458e-b3') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46d4458e-b3, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:22:27 user nova-compute[71482]: INFO os_vif [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:8e:dd,bridge_name='br-int',has_traffic_filtering=True,id=46d4458e-b33c-4f49-9625-e1ae1c191fb2,network=Network(f08bb357-59fb-44cf-a11e-1eaf17bbe75c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46d4458e-b3')
Apr 12 09:22:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Deleting instance files /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1_del
Apr 12 09:22:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Deletion of /opt/stack/data/nova/instances/c14c316b-deba-4835-acb5-7674420fd8d1_del complete
Apr 12 09:22:27 user nova-compute[71482]: INFO nova.compute.manager [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Took 0.64 seconds to destroy the instance on the hypervisor.
Apr 12 09:22:27 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:22:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received event network-vif-unplugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Acquiring lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] No waiting events found dispatching network-vif-unplugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received event network-vif-unplugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received event network-vif-plugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Acquiring lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] Lock "c14c316b-deba-4835-acb5-7674420fd8d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] No waiting events found dispatching network-vif-plugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:22:28 user nova-compute[71482]: WARNING nova.compute.manager [req-71fd07fd-4c25-4384-b0f3-af32c796b9d7 req-04c7258c-6e99-451f-bae4-0fc29c463b29 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received unexpected event network-vif-plugged-46d4458e-b33c-4f49-9625-e1ae1c191fb2 for instance with vm_state active and task_state deleting.
Apr 12 09:22:28 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:22:28 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Took 0.47 seconds to deallocate network for instance.
Apr 12 09:22:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-b899ccd8-74db-44fc-8774-b121ab03637c req-6ce7f315-70fb-489f-a7d2-d0a5654174f4 service nova] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Received event network-vif-deleted-46d4458e-b33c-4f49-9625-e1ae1c191fb2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:28 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Deleted allocations for instance c14c316b-deba-4835-acb5-7674420fd8d1
Apr 12 09:22:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c7492337-9a90-454b-8ae7-30ad6fbbfa91 tempest-VolumesNegativeTest-1969108914 tempest-VolumesNegativeTest-1969108914-project-member] Lock "c14c316b-deba-4835-acb5-7674420fd8d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.603s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:22:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:39 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291344.6333184, 4f211820-161b-4bef-b25d-ced137325da1 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:22:39 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 4f211820-161b-4bef-b25d-ced137325da1] VM Stopped (Lifecycle Event)
Apr 12 09:22:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-56bd463d-d044-4157-a96b-f93fe0dc60aa None None] [instance: 4f211820-161b-4bef-b25d-ced137325da1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:22:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:42 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291347.7013304, c14c316b-deba-4835-acb5-7674420fd8d1 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:22:42 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] VM Stopped (Lifecycle Event)
Apr 12 09:22:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2d87e86c-c040-4856-9c7d-586388b6abfb None None] [instance: c14c316b-deba-4835-acb5-7674420fd8d1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:22:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:22:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updating instance_info_cache with network_info: [{"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-4a835849-83a7-457d-a96d-0acaa5a4a964" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:22:55 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:22:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:02 user nova-compute[71482]: INFO nova.compute.manager [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Detaching volume dc5375ad-ca3d-4909-a1f0-42c140f9875d
Apr 12 09:23:02 user nova-compute[71482]: INFO nova.virt.block_device [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Attempting to driver detach volume dc5375ad-ca3d-4909-a1f0-42c140f9875d from mountpoint /dev/vdc
Apr 12 09:23:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Attempting to detach device vdc from instance 25232386-f51a-434b-9280-c4dd30b55f3d from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:23:02 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:23:02 user nova-compute[71482]:   <source dev="/dev/sdh"/>
Apr 12 09:23:02 user nova-compute[71482]:   <target dev="vdc" bus="virtio"/>
Apr 12 09:23:02 user nova-compute[71482]:   <serial>dc5375ad-ca3d-4909-a1f0-42c140f9875d</serial>
Apr 12 09:23:02 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 09:23:02 user nova-compute[71482]: </disk>
Apr 12 09:23:02 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:23:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully detached device vdc from instance 25232386-f51a-434b-9280-c4dd30b55f3d from the persistent domain config.
Apr 12 09:23:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 25232386-f51a-434b-9280-c4dd30b55f3d from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:23:02 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:23:02 user nova-compute[71482]:   <source dev="/dev/sdh"/>
Apr 12 09:23:02 user nova-compute[71482]:   <target dev="vdc" bus="virtio"/>
Apr 12 09:23:02 user nova-compute[71482]:   <serial>dc5375ad-ca3d-4909-a1f0-42c140f9875d</serial>
Apr 12 09:23:02 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 09:23:02 user nova-compute[71482]: </disk>
Apr 12 09:23:02 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681291382.6496086, 25232386-f51a-434b-9280-c4dd30b55f3d => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:23:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully detached device vdc from instance 25232386-f51a-434b-9280-c4dd30b55f3d from the live domain config.
Apr 12 09:23:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRgxfait', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:23:02 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bf2879-fe40-43c1-9953-62d5e1225105]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:23:02 user nova-compute[71482]: No targets found.
Apr 12 09:23:02 user nova-compute[71482]: iSNS:
Apr 12 09:23:02 user nova-compute[71482]: No targets found.
Apr 12 09:23:02 user nova-compute[71482]: STATIC:
Apr 12 09:23:02 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d
Apr 12 09:23:02 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:23:02 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:23:02 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d
Apr 12 09:23:02 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:23:02 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:23:02 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:23:02 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:23:02 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:23:02 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2
Apr 12 09:23:02 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:23:02 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:23:02 user nova-compute[71482]: FIRMWARE:
Apr 12 09:23:02 user nova-compute[71482]: No targets found.
Apr 12 09:23:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:23:02 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:23:02 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7494f1c4-31c2-4e4f-b716-7ac1aafe76de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6d82eb-5116-4b13-ae13-415e3390d38b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:23:02 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:23:02 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:23:02 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:23:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:23:02 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:23:02 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:23:02 user nova-compute[71482]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d (non-flash)
Apr 12 09:23:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c1cb9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d'): ({'sdh'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Removing single pathed devices sdh {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d7d610-6f2e-43ab-aec7-779b80e3a785]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba9b92-9cc2-4dc6-9c62-5be2bbe3a0e7]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flushing IO for device /dev/sdh {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3553310c-a8ae-42b9-90c2-15e1530afb4a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7643707-a5e5-4a21-904a-86849226bbc3]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] SCSI volumes sdh have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c42ab8e-89dd-483f-a7b0-67a597748f57]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f81554-dda9-4272-b15d-c38324486da7]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d, portal: 172.16.0.220,3260]
Apr 12 09:23:03 user nova-compute[71482]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d, portal: 172.16.0.220,3260] successful.
Apr 12 09:23:03 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc5375ad-ca3d-4909-a1f0-42c140f9875d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e960e4bc-97d9-4a0a-8752-16b9d8f3f484]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] <== disconnect_volume: return (406ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG nova.objects.instance [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'flavor' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4b225ef0-8ca8-4323-ae94-f5fb7b6d153e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.874s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:05 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:23:05 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7969MB free_disk=26.17449951171875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e442604c-86f4-45e1-9407-1764133852ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9691009c-8aca-4347-8e46-c5bdda13aa3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 825afa91-cf8c-477a-afbf-40af95b81c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 25232386-f51a-434b-9280-c4dd30b55f3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:23:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:06 user nova-compute[71482]: INFO nova.compute.manager [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Terminating instance
Apr 12 09:23:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG nova.compute.manager [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received event network-vif-unplugged-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG nova.compute.manager [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] No waiting events found dispatching network-vif-unplugged-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG nova.compute.manager [req-22c02a23-eb20-4bf3-a56f-b8476134ddd9 req-6449594f-b9f5-4118-975a-facef64601d1 service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received event network-vif-unplugged-3fe5d678-976e-467d-888f-4575a3cc2efe for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:07 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Instance destroyed successfully.
Apr 12 09:23:07 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'resources' on Instance uuid 9691009c-8aca-4347-8e46-c5bdda13aa3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1730277833',display_name='tempest-AttachVolumeNegativeTest-server-1730277833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1730277833',id=20,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcgOlYUwNuWHn3k/8NhVfKcsRRf00AtvCUtT94690EyQkY6DJedMcCl0px8XoQgNE4fdJsdkSkN6tuvI98c71siFzbUZTepADTU9efkAxglWffFn8akoG6jZa+wPJijqg==',key_name='tempest-keypair-65745046',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:17:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-gk85kmil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:17:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=9691009c-8aca-4347-8e46-c5bdda13aa3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "3fe5d678-976e-467d-888f-4575a3cc2efe", "address": "fa:16:3e:bb:c0:46", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fe5d678-97", "ovs_interfaceid": "3fe5d678-976e-467d-888f-4575a3cc2efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=3fe5d678-976e-467d-888f-4575a3cc2efe,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe5d678-97') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG os_vif [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=3fe5d678-976e-467d-888f-4575a3cc2efe,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe5d678-97') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fe5d678-97, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:07 user nova-compute[71482]: INFO os_vif [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:c0:46,bridge_name='br-int',has_traffic_filtering=True,id=3fe5d678-976e-467d-888f-4575a3cc2efe,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3fe5d678-97')
Apr 12 09:23:07 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Deleting instance files /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d_del
Apr 12 09:23:07 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Deletion of /opt/stack/data/nova/instances/9691009c-8aca-4347-8e46-c5bdda13aa3d_del complete
Apr 12 09:23:07 user nova-compute[71482]: INFO nova.compute.manager [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 12 09:23:07 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:23:07 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:23:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:08 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:08 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Took 0.72 seconds to deallocate network for instance.
Apr 12 09:23:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-04880061-3cd0-440b-a62d-11b8fe6a1b9c req-6eb29b5e-6e91-4d42-b065-76d28227322b service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received event network-vif-deleted-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:08 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:23:08 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:23:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:08 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Deleted allocations for instance 9691009c-8aca-4347-8e46-c5bdda13aa3d
Apr 12 09:23:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f054fa71-d9cf-4b9e-9f14-dfbf7847c970 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received event network-vif-plugged-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] Acquiring lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] Lock "9691009c-8aca-4347-8e46-c5bdda13aa3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] No waiting events found dispatching network-vif-plugged-3fe5d678-976e-467d-888f-4575a3cc2efe {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:09 user nova-compute[71482]: WARNING nova.compute.manager [req-ba45aa64-3d41-402d-8a6e-873843253107 req-a1efebfe-2b3b-4751-a2f9-b0bfedb6d464 service nova] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Received unexpected event network-vif-plugged-3fe5d678-976e-467d-888f-4575a3cc2efe for instance with vm_state deleted and task_state None.
Apr 12 09:23:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-changed-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Refreshing instance network info cache due to event network-changed-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] Acquiring lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] Acquired lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Refreshing network info cache for port a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:15 user nova-compute[71482]: INFO nova.compute.manager [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Detaching volume d1961f4e-4a3f-46cc-95a2-6177a29efeb2
Apr 12 09:23:15 user nova-compute[71482]: INFO nova.virt.block_device [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Attempting to driver detach volume d1961f4e-4a3f-46cc-95a2-6177a29efeb2 from mountpoint /dev/vdb
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Attempting to detach device vdb from instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:23:15 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:23:15 user nova-compute[71482]:   <source dev="/dev/sde"/>
Apr 12 09:23:15 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:23:15 user nova-compute[71482]:   <serial>d1961f4e-4a3f-46cc-95a2-6177a29efeb2</serial>
Apr 12 09:23:15 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:23:15 user nova-compute[71482]: </disk>
Apr 12 09:23:15 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:23:15 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Successfully detached device vdb from instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 from the persistent domain config.
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:23:15 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:23:15 user nova-compute[71482]:   <source dev="/dev/sde"/>
Apr 12 09:23:15 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:23:15 user nova-compute[71482]:   <serial>d1961f4e-4a3f-46cc-95a2-6177a29efeb2</serial>
Apr 12 09:23:15 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:23:15 user nova-compute[71482]: </disk>
Apr 12 09:23:15 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updated VIF entry in instance network info cache for port a0e06b9c-27fc-47a2-a5d1-0da741a09eaa. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating instance_info_cache with network_info: [{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-44ec56d4-007d-4592-b378-90f882b06f34 req-0b2f64ed-bc46-48e8-a600-fa3476147c9f service nova] Releasing lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "d2be3178-85b4-4012-a7d0-2d8543a65a42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:23:15 user nova-compute[71482]: INFO nova.compute.claims [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Claim successful on node user
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681291395.933518, 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:23:15 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Successfully detached device vdb from instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 from the live domain config.
Apr 12 09:23:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlRDhqQN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:23:15 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:23:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8796502f-21b6-4117-8973-bf88e1f8668a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:23:15 user nova-compute[71482]: No targets found.
Apr 12 09:23:15 user nova-compute[71482]: iSNS:
Apr 12 09:23:15 user nova-compute[71482]: No targets found.
Apr 12 09:23:15 user nova-compute[71482]: STATIC:
Apr 12 09:23:15 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d
Apr 12 09:23:15 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:23:15 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:23:15 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:23:15 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:23:15 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:23:15 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2
Apr 12 09:23:15 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:23:15 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:23:15 user nova-compute[71482]: FIRMWARE:
Apr 12 09:23:15 user nova-compute[71482]: No targets found.
Apr 12 09:23:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:23:15 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:23:15 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:23:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6ebfea-a84c-435e-a646-ec90a4f714bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cad15c-9ad1-4841-ad91-73233b970da3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:23:16 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:23:16 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:23:16 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:23:16 user nova-compute[71482]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 (non-flash)
Apr 12 09:23:16 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:23:16 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c1c8280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2'): ({'sde'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Removing single pathed devices sde {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[831a2987-12f0-4ca0-96b9-a651366664ff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[973c06dd-3cbe-45c2-aacd-7b2ebc05b748]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Flushing IO for device /dev/sde {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea2435f-d116-4f79-ab13-9387e812a961]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b8fcbc-cf4d-4c13-88cb-89710f7276c6]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] SCSI volumes sde have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d64296e-5efa-4f2d-b295-77c2ae88e99d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a433d3-dd12-4a8c-906a-9d842812ad7f]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2, portal: 172.16.0.220,3260]
Apr 12 09:23:16 user nova-compute[71482]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2, portal: 172.16.0.220,3260] successful.
Apr 12 09:23:16 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1961f4e-4a3f-46cc-95a2-6177a29efeb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff74bca3-a1fc-4947-9147-e9813ba6f0c4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] <== disconnect_volume: return (306ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:23:16 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.policy [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:23:16 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Creating image(s)
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "/opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "/opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.165s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk 1073741824" returned: 0 in 0.049s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:23:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG nova.objects.instance [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'flavor' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-changed-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Refreshing instance network info cache due to event network-changed-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] Acquiring lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] Acquired lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG nova.network.neutron [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Refreshing network info cache for port a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Cannot resize image /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'migration_context' on Instance uuid d2be3178-85b4-4012-a7d0-2d8543a65a42 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Ensure instance console log exists: /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Successfully created port: 0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-340d6bdd-1b52-4185-babf-77efd689f961 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.763s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updated VIF entry in instance network info cache for port a0e06b9c-27fc-47a2-a5d1-0da741a09eaa. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating instance_info_cache with network_info: [{"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-92e3e08f-2227-4d15-ab2f-dd7b3815325b req-34dfb790-614a-4a09-8f56-3831757d59bd service nova] Releasing lock "refresh_cache-0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Successfully updated port: 0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updating instance_info_cache with network_info: [{"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Instance network_info: |[{"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Start _get_guest_xml network_info=[{"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:23:18 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:23:18 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-733421240',display_name='tempest-ServerActionsTestJSON-server-733421240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-733421240',id=26,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-wv318c4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=d2be3178-85b4-4012-a7d0-2d8543a65a42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:fa:ab,bridge_name='br-int',has_traffic_filtering=True,id=0ea8781f-860c-4135-8264-ad52a792fa55,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea8781f-86') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'pci_devices' on Instance uuid d2be3178-85b4-4012-a7d0-2d8543a65a42 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:23:18 user nova-compute[71482]:   <uuid>d2be3178-85b4-4012-a7d0-2d8543a65a42</uuid>
Apr 12 09:23:18 user nova-compute[71482]:   <name>instance-0000001a</name>
Apr 12 09:23:18 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:23:18 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:23:18 user nova-compute[71482]:   <metadata>
Apr 12 09:23:18 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:23:18 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:23:18 user nova-compute[71482]:       <nova:name>tempest-ServerActionsTestJSON-server-733421240</nova:name>
Apr 12 09:23:18 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:23:18</nova:creationTime>
Apr 12 09:23:18 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:23:18 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:23:18 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:23:18 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:23:18 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:23:18 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:23:18 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:23:18 user nova-compute[71482]:       <nova:owner>
Apr 12 09:23:18 user nova-compute[71482]:         <nova:user uuid="375db5b9a80244d3878822049230ba47">tempest-ServerActionsTestJSON-1142062861-project-member</nova:user>
Apr 12 09:23:18 user nova-compute[71482]:         <nova:project uuid="20b8c89c46bb460f9f94be9426a22bb8">tempest-ServerActionsTestJSON-1142062861</nova:project>
Apr 12 09:23:18 user nova-compute[71482]:       </nova:owner>
Apr 12 09:23:18 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:23:18 user nova-compute[71482]:       <nova:ports>
Apr 12 09:23:18 user nova-compute[71482]:         <nova:port uuid="0ea8781f-860c-4135-8264-ad52a792fa55">
Apr 12 09:23:18 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:23:18 user nova-compute[71482]:         </nova:port>
Apr 12 09:23:18 user nova-compute[71482]:       </nova:ports>
Apr 12 09:23:18 user nova-compute[71482]:     </nova:instance>
Apr 12 09:23:18 user nova-compute[71482]:   </metadata>
Apr 12 09:23:18 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:23:18 user nova-compute[71482]:     <system>
Apr 12 09:23:18 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:23:18 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:23:18 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:23:18 user nova-compute[71482]:       <entry name="serial">d2be3178-85b4-4012-a7d0-2d8543a65a42</entry>
Apr 12 09:23:18 user nova-compute[71482]:       <entry name="uuid">d2be3178-85b4-4012-a7d0-2d8543a65a42</entry>
Apr 12 09:23:18 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:23:18 user nova-compute[71482]:     </system>
Apr 12 09:23:18 user nova-compute[71482]:   </sysinfo>
Apr 12 09:23:18 user nova-compute[71482]:   <os>
Apr 12 09:23:18 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:23:18 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:23:18 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:23:18 user nova-compute[71482]:   </os>
Apr 12 09:23:18 user nova-compute[71482]:   <features>
Apr 12 09:23:18 user nova-compute[71482]:     <acpi/>
Apr 12 09:23:18 user nova-compute[71482]:     <apic/>
Apr 12 09:23:18 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:23:18 user nova-compute[71482]:   </features>
Apr 12 09:23:18 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:23:18 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:23:18 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:23:18 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:23:18 user nova-compute[71482]:   </clock>
Apr 12 09:23:18 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:23:18 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:23:18 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:23:18 user nova-compute[71482]:   </cpu>
Apr 12 09:23:18 user nova-compute[71482]:   <devices>
Apr 12 09:23:18 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:23:18 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:23:18 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk"/>
Apr 12 09:23:18 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:23:18 user nova-compute[71482]:     </disk>
Apr 12 09:23:18 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:23:18 user nova-compute[71482]:       <mac address="fa:16:3e:b4:fa:ab"/>
Apr 12 09:23:18 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:23:18 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:23:18 user nova-compute[71482]:       <target dev="tap0ea8781f-86"/>
Apr 12 09:23:18 user nova-compute[71482]:     </interface>
Apr 12 09:23:18 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:23:18 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/console.log" append="off"/>
Apr 12 09:23:18 user nova-compute[71482]:     </serial>
Apr 12 09:23:18 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:23:18 user nova-compute[71482]:     <video>
Apr 12 09:23:18 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:23:18 user nova-compute[71482]:     </video>
Apr 12 09:23:18 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:23:18 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:23:18 user nova-compute[71482]:     </rng>
Apr 12 09:23:18 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:23:18 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:23:18 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:23:18 user nova-compute[71482]:     </memballoon>
Apr 12 09:23:18 user nova-compute[71482]:   </devices>
Apr 12 09:23:18 user nova-compute[71482]: </domain>
Apr 12 09:23:18 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-733421240',display_name='tempest-ServerActionsTestJSON-server-733421240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-733421240',id=26,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-wv318c4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:23:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=d2be3178-85b4-4012-a7d0-2d8543a65a42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:fa:ab,bridge_name='br-int',has_traffic_filtering=True,id=0ea8781f-860c-4135-8264-ad52a792fa55,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea8781f-86') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG os_vif [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:fa:ab,bridge_name='br-int',has_traffic_filtering=True,id=0ea8781f-860c-4135-8264-ad52a792fa55,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea8781f-86') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ea8781f-86, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0ea8781f-86, col_values=(('external_ids', {'iface-id': '0ea8781f-860c-4135-8264-ad52a792fa55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:fa:ab', 'vm-uuid': 'd2be3178-85b4-4012-a7d0-2d8543a65a42'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:18 user nova-compute[71482]: INFO os_vif [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:fa:ab,bridge_name='br-int',has_traffic_filtering=True,id=0ea8781f-860c-4135-8264-ad52a792fa55,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea8781f-86')
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:23:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No VIF found with MAC fa:16:3e:b4:fa:ab, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:23:19 user nova-compute[71482]: DEBUG nova.compute.manager [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received event network-changed-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:19 user nova-compute[71482]: DEBUG nova.compute.manager [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Refreshing instance network info cache due to event network-changed-0ea8781f-860c-4135-8264-ad52a792fa55. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:23:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] Acquiring lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:23:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] Acquired lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:23:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Refreshing network info cache for port 0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:23:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updated VIF entry in instance network info cache for port 0ea8781f-860c-4135-8264-ad52a792fa55. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:23:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updating instance_info_cache with network_info: [{"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-033e5708-ef89-49c3-9955-ac5936ff6fa7 req-1a41622d-33ab-4ddc-8872-ba3f0b539fb6 service nova] Releasing lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:23:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received event network-vif-plugged-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] Acquiring lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] No waiting events found dispatching network-vif-plugged-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:20 user nova-compute[71482]: WARNING nova.compute.manager [req-7b755d8b-d57b-4034-96e8-41efd80be698 req-e9be2629-44d6-4bb5-9de0-db4dcb59da8f service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received unexpected event network-vif-plugged-0ea8781f-860c-4135-8264-ad52a792fa55 for instance with vm_state building and task_state spawning.
Apr 12 09:23:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291402.4212582, d2be3178-85b4-4012-a7d0-2d8543a65a42 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:23:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] VM Resumed (Lifecycle Event)
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:23:22 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Instance spawned successfully.
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291402.4220452, d2be3178-85b4-4012-a7d0-2d8543a65a42 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:23:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] VM Started (Lifecycle Event)
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:23:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:23:22 user nova-compute[71482]: INFO nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Took 6.11 seconds to spawn the instance on the hypervisor.
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received event network-vif-plugged-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] Acquiring lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] No waiting events found dispatching network-vif-plugged-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:22 user nova-compute[71482]: WARNING nova.compute.manager [req-6e191cfa-916b-4593-ab65-36f12041855d req-77595ae7-606f-4df8-a9e5-acff29e31679 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received unexpected event network-vif-plugged-0ea8781f-860c-4135-8264-ad52a792fa55 for instance with vm_state building and task_state spawning.
Apr 12 09:23:22 user nova-compute[71482]: INFO nova.compute.manager [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Took 6.88 seconds to build instance.
Apr 12 09:23:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5aa6450-047f-4578-90db-6dbc7107fc14 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.981s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291387.6986947, 9691009c-8aca-4347-8e46-c5bdda13aa3d => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:23:22 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] VM Stopped (Lifecycle Event)
Apr 12 09:23:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4aba3c53-28a6-409f-a408-236b3188b3f2 None None] [instance: 9691009c-8aca-4347-8e46-c5bdda13aa3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "2f60c685-1b91-4700-aa57-a4a272ea166a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:23:37 user nova-compute[71482]: INFO nova.compute.claims [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Claim successful on node user
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.network.neutron [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:23:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.policy [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e432c3374fe34540b47999d4cc361e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f752416df0d043a4b82b204a780f597c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:23:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Creating image(s)
Apr 12 09:23:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "/opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "/opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk 1073741824" returned: 0 in 0.051s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG nova.network.neutron [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Successfully created port: 3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Cannot resize image /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG nova.objects.instance [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lazy-loading 'migration_context' on Instance uuid 2f60c685-1b91-4700-aa57-a4a272ea166a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Ensure instance console log exists: /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Successfully updated port: 3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "refresh_cache-2f60c685-1b91-4700-aa57-a4a272ea166a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquired lock "refresh_cache-2f60c685-1b91-4700-aa57-a4a272ea166a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received event network-changed-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Refreshing instance network info cache due to event network-changed-3e8de34b-35fa-429c-8449-262a4b6c37cd. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] Acquiring lock "refresh_cache-2f60c685-1b91-4700-aa57-a4a272ea166a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Updating instance_info_cache with network_info: [{"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Releasing lock "refresh_cache-2f60c685-1b91-4700-aa57-a4a272ea166a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Instance network_info: |[{"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] Acquired lock "refresh_cache-2f60c685-1b91-4700-aa57-a4a272ea166a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG nova.network.neutron [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Refreshing network info cache for port 3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:23:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Start _get_guest_xml network_info=[{"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:23:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:23:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-623755002',display_name='tempest-VolumesActionsTest-instance-623755002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-623755002',id=27,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f752416df0d043a4b82b204a780f597c',ramdisk_id='',reservation_id='r-ad8qxi0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-902475152',owner_user_name='tempest-VolumesActionsTest-902475152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:23:38Z,user_data=None,user_id='e432c3374fe34540b47999d4cc361e0e',uuid=2f60c685-1b91-4700-aa57-a4a272ea166a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converting VIF {"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b6:b5,bridge_name='br-int',has_traffic_filtering=True,id=3e8de34b-35fa-429c-8449-262a4b6c37cd,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8de34b-35') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.objects.instance [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f60c685-1b91-4700-aa57-a4a272ea166a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:23:40 user nova-compute[71482]:   <uuid>2f60c685-1b91-4700-aa57-a4a272ea166a</uuid>
Apr 12 09:23:40 user nova-compute[71482]:   <name>instance-0000001b</name>
Apr 12 09:23:40 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:23:40 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:23:40 user nova-compute[71482]:   <metadata>
Apr 12 09:23:40 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:23:40 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:23:40 user nova-compute[71482]:       <nova:name>tempest-VolumesActionsTest-instance-623755002</nova:name>
Apr 12 09:23:40 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:23:40</nova:creationTime>
Apr 12 09:23:40 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:23:40 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:23:40 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:23:40 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:23:40 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:23:40 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:23:40 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:23:40 user nova-compute[71482]:       <nova:owner>
Apr 12 09:23:40 user nova-compute[71482]:         <nova:user uuid="e432c3374fe34540b47999d4cc361e0e">tempest-VolumesActionsTest-902475152-project-member</nova:user>
Apr 12 09:23:40 user nova-compute[71482]:         <nova:project uuid="f752416df0d043a4b82b204a780f597c">tempest-VolumesActionsTest-902475152</nova:project>
Apr 12 09:23:40 user nova-compute[71482]:       </nova:owner>
Apr 12 09:23:40 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:23:40 user nova-compute[71482]:       <nova:ports>
Apr 12 09:23:40 user nova-compute[71482]:         <nova:port uuid="3e8de34b-35fa-429c-8449-262a4b6c37cd">
Apr 12 09:23:40 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 12 09:23:40 user nova-compute[71482]:         </nova:port>
Apr 12 09:23:40 user nova-compute[71482]:       </nova:ports>
Apr 12 09:23:40 user nova-compute[71482]:     </nova:instance>
Apr 12 09:23:40 user nova-compute[71482]:   </metadata>
Apr 12 09:23:40 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:23:40 user nova-compute[71482]:     <system>
Apr 12 09:23:40 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:23:40 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:23:40 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:23:40 user nova-compute[71482]:       <entry name="serial">2f60c685-1b91-4700-aa57-a4a272ea166a</entry>
Apr 12 09:23:40 user nova-compute[71482]:       <entry name="uuid">2f60c685-1b91-4700-aa57-a4a272ea166a</entry>
Apr 12 09:23:40 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:23:40 user nova-compute[71482]:     </system>
Apr 12 09:23:40 user nova-compute[71482]:   </sysinfo>
Apr 12 09:23:40 user nova-compute[71482]:   <os>
Apr 12 09:23:40 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:23:40 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:23:40 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:23:40 user nova-compute[71482]:   </os>
Apr 12 09:23:40 user nova-compute[71482]:   <features>
Apr 12 09:23:40 user nova-compute[71482]:     <acpi/>
Apr 12 09:23:40 user nova-compute[71482]:     <apic/>
Apr 12 09:23:40 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:23:40 user nova-compute[71482]:   </features>
Apr 12 09:23:40 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:23:40 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:23:40 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:23:40 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:23:40 user nova-compute[71482]:   </clock>
Apr 12 09:23:40 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:23:40 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:23:40 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:23:40 user nova-compute[71482]:   </cpu>
Apr 12 09:23:40 user nova-compute[71482]:   <devices>
Apr 12 09:23:40 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:23:40 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:23:40 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk"/>
Apr 12 09:23:40 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:23:40 user nova-compute[71482]:     </disk>
Apr 12 09:23:40 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:23:40 user nova-compute[71482]:       <mac address="fa:16:3e:99:b6:b5"/>
Apr 12 09:23:40 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:23:40 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:23:40 user nova-compute[71482]:       <target dev="tap3e8de34b-35"/>
Apr 12 09:23:40 user nova-compute[71482]:     </interface>
Apr 12 09:23:40 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:23:40 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/console.log" append="off"/>
Apr 12 09:23:40 user nova-compute[71482]:     </serial>
Apr 12 09:23:40 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:23:40 user nova-compute[71482]:     <video>
Apr 12 09:23:40 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:23:40 user nova-compute[71482]:     </video>
Apr 12 09:23:40 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:23:40 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:23:40 user nova-compute[71482]:     </rng>
Apr 12 09:23:40 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:23:40 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:23:40 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:23:40 user nova-compute[71482]:     </memballoon>
Apr 12 09:23:40 user nova-compute[71482]:   </devices>
Apr 12 09:23:40 user nova-compute[71482]: </domain>
Apr 12 09:23:40 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-623755002',display_name='tempest-VolumesActionsTest-instance-623755002',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-623755002',id=27,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f752416df0d043a4b82b204a780f597c',ramdisk_id='',reservation_id='r-ad8qxi0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-902475152',owner_user_name='tempest-VolumesActionsTest-902475152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:23:38Z,user_data=None,user_id='e432c3374fe34540b47999d4cc361e0e',uuid=2f60c685-1b91-4700-aa57-a4a272ea166a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converting VIF {"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b6:b5,bridge_name='br-int',has_traffic_filtering=True,id=3e8de34b-35fa-429c-8449-262a4b6c37cd,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8de34b-35') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG os_vif [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b6:b5,bridge_name='br-int',has_traffic_filtering=True,id=3e8de34b-35fa-429c-8449-262a4b6c37cd,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8de34b-35') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e8de34b-35, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e8de34b-35, col_values=(('external_ids', {'iface-id': '3e8de34b-35fa-429c-8449-262a4b6c37cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:b6:b5', 'vm-uuid': '2f60c685-1b91-4700-aa57-a4a272ea166a'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:40 user nova-compute[71482]: INFO os_vif [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b6:b5,bridge_name='br-int',has_traffic_filtering=True,id=3e8de34b-35fa-429c-8449-262a4b6c37cd,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8de34b-35')
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] No VIF found with MAC fa:16:3e:99:b6:b5, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.network.neutron [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Updated VIF entry in instance network info cache for port 3e8de34b-35fa-429c-8449-262a4b6c37cd. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG nova.network.neutron [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Updating instance_info_cache with network_info: [{"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f08f0633-a5e0-4ecf-8e0f-38e0ed16970c req-57836dc7-f2c4-4b07-8375-7d8515eb60ef service nova] Releasing lock "refresh_cache-2f60c685-1b91-4700-aa57-a4a272ea166a" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:23:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received event network-vif-plugged-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] Acquiring lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] No waiting events found dispatching network-vif-plugged-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:41 user nova-compute[71482]: WARNING nova.compute.manager [req-718cba48-07c6-41df-9be2-cca0024c7deb req-c8818cda-a8a3-4621-a836-fc22439a256b service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received unexpected event network-vif-plugged-3e8de34b-35fa-429c-8449-262a4b6c37cd for instance with vm_state building and task_state spawning.
Apr 12 09:23:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291423.5529392, 2f60c685-1b91-4700-aa57-a4a272ea166a => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:23:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] VM Resumed (Lifecycle Event)
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:23:43 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Instance spawned successfully.
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:23:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291423.5552144, 2f60c685-1b91-4700-aa57-a4a272ea166a => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:23:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] VM Started (Lifecycle Event)
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:23:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:23:43 user nova-compute[71482]: INFO nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Took 5.68 seconds to spawn the instance on the hypervisor.
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received event network-vif-plugged-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] Acquiring lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] No waiting events found dispatching network-vif-plugged-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:43 user nova-compute[71482]: WARNING nova.compute.manager [req-0d81759a-b225-4d44-8199-31079c73824c req-23c4ca15-9cc7-436e-a630-c192a3a56cf4 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received unexpected event network-vif-plugged-3e8de34b-35fa-429c-8449-262a4b6c37cd for instance with vm_state building and task_state spawning.
Apr 12 09:23:43 user nova-compute[71482]: INFO nova.compute.manager [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Took 6.45 seconds to build instance.
Apr 12 09:23:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-10c3e4bf-d797-4dfe-8809-e711f27bf176 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.539s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:50 user nova-compute[71482]: INFO nova.compute.manager [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Unrescuing
Apr 12 09:23:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquired lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Updating instance_info_cache with network_info: [{"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Releasing lock "refresh_cache-825afa91-cf8c-477a-afbf-40af95b81c76" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG nova.objects.instance [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'flavor' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:50 user nova-compute[71482]: WARNING nova.compute.manager [req-bfb806d8-4462-4b46-8026-faae8f87f64a req-e051b987-50c0-4142-bd6b-5144763b5ced service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:23:50 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:23:50 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:23:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:51 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Instance destroyed successfully.
Apr 12 09:23:51 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updating instance_info_cache with network_info: [{"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-6f58bf6a-beec-40e5-b8be-de03539038f8" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:23:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:52 user nova-compute[71482]: INFO nova.compute.manager [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Terminating instance
Apr 12 09:23:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-unplugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] No waiting events found dispatching network-vif-unplugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-e9f019e8-50e2-45e2-8390-7c66d4eb4826 req-9f789758-d475-4345-966d-499e325ebc3a service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-unplugged-1cf7a879-f705-467c-af44-2b2d40216cef for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:52 user nova-compute[71482]: WARNING nova.compute.manager [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:23:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:52 user nova-compute[71482]: WARNING nova.compute.manager [req-eeaa5d44-4ac7-42de-b1d7-461db035561d req-9461bac1-346d-43d6-9367-99111dd7d4b4 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:53 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Instance destroyed successfully.
Apr 12 09:23:53 user nova-compute[71482]: DEBUG nova.objects.instance [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'resources' on Instance uuid 25232386-f51a-434b-9280-c4dd30b55f3d {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:17:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-325803830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-325803830',id=19,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4JkdmcZevwkBRIvOxZXR/GY5jcnavNiZ74hKGbOyliYHO5bVun8yU8w+4IBWoQC5ayotvjMWHRPPGubYFeG7cJoQLiULRqOwjpOnp0kPQmpgv3dBxk2vLFWpUFCoUImw==',key_name='tempest-keypair-501602451',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:21:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-ngwjnp8r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=25232386-f51a-434b-9280-c4dd30b55f3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "1cf7a879-f705-467c-af44-2b2d40216cef", "address": "fa:16:3e:d5:74:bc", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cf7a879-f7", "ovs_interfaceid": "1cf7a879-f705-467c-af44-2b2d40216cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG os_vif [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cf7a879-f7, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:53 user nova-compute[71482]: INFO os_vif [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:74:bc,bridge_name='br-int',has_traffic_filtering=True,id=1cf7a879-f705-467c-af44-2b2d40216cef,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cf7a879-f7')
Apr 12 09:23:53 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Deleting instance files /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d_del
Apr 12 09:23:53 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Deletion of /opt/stack/data/nova/instances/25232386-f51a-434b-9280-c4dd30b55f3d_del complete
Apr 12 09:23:53 user nova-compute[71482]: INFO nova.compute.manager [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 12 09:23:53 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:23:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:23:54 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Took 0.71 seconds to deallocate network for instance.
Apr 12 09:23:54 user nova-compute[71482]: DEBUG nova.compute.manager [req-5c76343d-72d3-48f0-a2f1-fa9c05182c48 req-0855f679-42d3-46ec-8663-b7b3d0b2f1f5 service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-deleted-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:54 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Deleted allocations for instance 25232386-f51a-434b-9280-c4dd30b55f3d
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-adcf6bd9-749a-4f06-9cf5-168c77b6178e tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "25232386-f51a-434b-9280-c4dd30b55f3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.150s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG nova.compute.manager [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] Acquiring lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] Lock "25232386-f51a-434b-9280-c4dd30b55f3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG nova.compute.manager [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] No waiting events found dispatching network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:54 user nova-compute[71482]: WARNING nova.compute.manager [req-ed8e56c3-5280-46d3-93b6-f383d20434c2 req-9d5220a9-6189-48cf-9709-dea38f123d0e service nova] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Received unexpected event network-vif-plugged-1cf7a879-f705-467c-af44-2b2d40216cef for instance with vm_state deleted and task_state None.
Apr 12 09:23:54 user nova-compute[71482]: DEBUG nova.compute.manager [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:23:54 user nova-compute[71482]: DEBUG nova.compute.manager [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:23:54 user nova-compute[71482]: WARNING nova.compute.manager [req-6d4fa31e-1705-4e5b-aed0-b7a9f676b29b req-3364b75c-5511-4101-9e04-176ecea64e59 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state rescued and task_state unrescuing.
Apr 12 09:23:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 825afa91-cf8c-477a-afbf-40af95b81c76 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:23:55 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291435.0171418, 825afa91-cf8c-477a-afbf-40af95b81c76 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:23:55 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] VM Resumed (Lifecycle Event)
Apr 12 09:23:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-c5c5b327-3be6-482d-acbd-e675927fd829 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:55 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:23:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:23:55 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 12 09:23:55 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291435.0210838, 825afa91-cf8c-477a-afbf-40af95b81c76 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:23:55 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] VM Started (Lifecycle Event)
Apr 12 09:23:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:23:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:23:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:23:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:23:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:23:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:24:00 user nova-compute[71482]: INFO nova.compute.claims [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Claim successful on node user
Apr 12 09:24:00 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:24:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:24:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.policy [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:24:01 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Creating image(s)
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "/opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "/opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "/opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk 1073741824" returned: 0 in 0.047s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.187s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Successfully created port: 1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Cannot resize image /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.objects.instance [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'migration_context' on Instance uuid d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Ensure instance console log exists: /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Successfully updated port: 1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "refresh_cache-d64edc05-fbf3-4f89-908f-ca221919c596" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquired lock "refresh_cache-d64edc05-fbf3-4f89-908f-ca221919c596" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received event network-changed-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Refreshing instance network info cache due to event network-changed-1f40ed54-078b-4028-95a6-6b5788a57cad. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] Acquiring lock "refresh_cache-d64edc05-fbf3-4f89-908f-ca221919c596" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Updating instance_info_cache with network_info: [{"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Releasing lock "refresh_cache-d64edc05-fbf3-4f89-908f-ca221919c596" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Instance network_info: |[{"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] Acquired lock "refresh_cache-d64edc05-fbf3-4f89-908f-ca221919c596" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.network.neutron [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Refreshing network info cache for port 1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Start _get_guest_xml network_info=[{"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:24:02 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:24:02 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-570926451',display_name='tempest-AttachVolumeNegativeTest-server-570926451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-570926451',id=28,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQvNBBITxsZM9HuPSiY+QeZXsqErxagnjcOfJSEEh8Hxht3gNkT9m9qDL9dit5iq1Z2fJAWET+og+pU/DVCG+EfQBdzSQWdTogdyqzLzRAYHWUbY3WYrPn4HTz5OdXtDQ==',key_name='tempest-keypair-1087718719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-wnapsgil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=d64edc05-fbf3-4f89-908f-ca221919c596,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:57:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f40ed54-078b-4028-95a6-6b5788a57cad,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f40ed54-07') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'pci_devices' on Instance uuid d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:24:02 user nova-compute[71482]:   <uuid>d64edc05-fbf3-4f89-908f-ca221919c596</uuid>
Apr 12 09:24:02 user nova-compute[71482]:   <name>instance-0000001c</name>
Apr 12 09:24:02 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:24:02 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:24:02 user nova-compute[71482]:   <metadata>
Apr 12 09:24:02 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:24:02 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:24:02 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeNegativeTest-server-570926451</nova:name>
Apr 12 09:24:02 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:24:02</nova:creationTime>
Apr 12 09:24:02 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:24:02 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:24:02 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:24:02 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:24:02 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:24:02 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:24:02 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:24:02 user nova-compute[71482]:       <nova:owner>
Apr 12 09:24:02 user nova-compute[71482]:         <nova:user uuid="5f91fed06f9547d29125f38fe2d47221">tempest-AttachVolumeNegativeTest-395431601-project-member</nova:user>
Apr 12 09:24:02 user nova-compute[71482]:         <nova:project uuid="37b4beaf457f4120bcbcd2b033d5c3db">tempest-AttachVolumeNegativeTest-395431601</nova:project>
Apr 12 09:24:02 user nova-compute[71482]:       </nova:owner>
Apr 12 09:24:02 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:24:02 user nova-compute[71482]:       <nova:ports>
Apr 12 09:24:02 user nova-compute[71482]:         <nova:port uuid="1f40ed54-078b-4028-95a6-6b5788a57cad">
Apr 12 09:24:02 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 12 09:24:02 user nova-compute[71482]:         </nova:port>
Apr 12 09:24:02 user nova-compute[71482]:       </nova:ports>
Apr 12 09:24:02 user nova-compute[71482]:     </nova:instance>
Apr 12 09:24:02 user nova-compute[71482]:   </metadata>
Apr 12 09:24:02 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:24:02 user nova-compute[71482]:     <system>
Apr 12 09:24:02 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:24:02 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:24:02 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:24:02 user nova-compute[71482]:       <entry name="serial">d64edc05-fbf3-4f89-908f-ca221919c596</entry>
Apr 12 09:24:02 user nova-compute[71482]:       <entry name="uuid">d64edc05-fbf3-4f89-908f-ca221919c596</entry>
Apr 12 09:24:02 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:24:02 user nova-compute[71482]:     </system>
Apr 12 09:24:02 user nova-compute[71482]:   </sysinfo>
Apr 12 09:24:02 user nova-compute[71482]:   <os>
Apr 12 09:24:02 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:24:02 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:24:02 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:24:02 user nova-compute[71482]:   </os>
Apr 12 09:24:02 user nova-compute[71482]:   <features>
Apr 12 09:24:02 user nova-compute[71482]:     <acpi/>
Apr 12 09:24:02 user nova-compute[71482]:     <apic/>
Apr 12 09:24:02 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:24:02 user nova-compute[71482]:   </features>
Apr 12 09:24:02 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:24:02 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:24:02 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:24:02 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:24:02 user nova-compute[71482]:   </clock>
Apr 12 09:24:02 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:24:02 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:24:02 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:24:02 user nova-compute[71482]:   </cpu>
Apr 12 09:24:02 user nova-compute[71482]:   <devices>
Apr 12 09:24:02 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:24:02 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:24:02 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk"/>
Apr 12 09:24:02 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:24:02 user nova-compute[71482]:     </disk>
Apr 12 09:24:02 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:24:02 user nova-compute[71482]:       <mac address="fa:16:3e:e5:57:bd"/>
Apr 12 09:24:02 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:24:02 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:24:02 user nova-compute[71482]:       <target dev="tap1f40ed54-07"/>
Apr 12 09:24:02 user nova-compute[71482]:     </interface>
Apr 12 09:24:02 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:24:02 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/console.log" append="off"/>
Apr 12 09:24:02 user nova-compute[71482]:     </serial>
Apr 12 09:24:02 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:24:02 user nova-compute[71482]:     <video>
Apr 12 09:24:02 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:24:02 user nova-compute[71482]:     </video>
Apr 12 09:24:02 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:24:02 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:24:02 user nova-compute[71482]:     </rng>
Apr 12 09:24:02 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:24:02 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:24:02 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:24:02 user nova-compute[71482]:     </memballoon>
Apr 12 09:24:02 user nova-compute[71482]:   </devices>
Apr 12 09:24:02 user nova-compute[71482]: </domain>
Apr 12 09:24:02 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-570926451',display_name='tempest-AttachVolumeNegativeTest-server-570926451',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-570926451',id=28,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQvNBBITxsZM9HuPSiY+QeZXsqErxagnjcOfJSEEh8Hxht3gNkT9m9qDL9dit5iq1Z2fJAWET+og+pU/DVCG+EfQBdzSQWdTogdyqzLzRAYHWUbY3WYrPn4HTz5OdXtDQ==',key_name='tempest-keypair-1087718719',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-wnapsgil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=d64edc05-fbf3-4f89-908f-ca221919c596,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:57:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f40ed54-078b-4028-95a6-6b5788a57cad,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f40ed54-07') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG os_vif [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:57:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f40ed54-078b-4028-95a6-6b5788a57cad,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f40ed54-07') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f40ed54-07, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1f40ed54-07, col_values=(('external_ids', {'iface-id': '1f40ed54-078b-4028-95a6-6b5788a57cad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:57:bd', 'vm-uuid': 'd64edc05-fbf3-4f89-908f-ca221919c596'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:02 user nova-compute[71482]: INFO os_vif [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:57:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f40ed54-078b-4028-95a6-6b5788a57cad,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f40ed54-07')
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:24:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No VIF found with MAC fa:16:3e:e5:57:bd, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:24:03 user nova-compute[71482]: DEBUG nova.network.neutron [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Updated VIF entry in instance network info cache for port 1f40ed54-078b-4028-95a6-6b5788a57cad. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:24:03 user nova-compute[71482]: DEBUG nova.network.neutron [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Updating instance_info_cache with network_info: [{"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:24:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e514acef-7e95-45e0-8dfc-921c041004b5 req-4c1de582-bbdd-4670-acbd-652f6f158b9c service nova] Releasing lock "refresh_cache-d64edc05-fbf3-4f89-908f-ca221919c596" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:24:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received event network-vif-plugged-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] No waiting events found dispatching network-vif-plugged-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:24:04 user nova-compute[71482]: WARNING nova.compute.manager [req-029b2403-1c9a-4095-b8c9-928d5e90db27 req-0f7c7536-ae95-4e53-b78a-873daa5985ef service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received unexpected event network-vif-plugged-1f40ed54-078b-4028-95a6-6b5788a57cad for instance with vm_state building and task_state spawning.
Apr 12 09:24:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:05 user nova-compute[71482]: INFO nova.compute.manager [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Terminating instance
Apr 12 09:24:05 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.155s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-unplugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-unplugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-69c163cd-8b0d-40f4-9c96-45ad9cbd45f7 req-e8abbcbb-c7ff-42a6-aa77-cc7683305e41 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-unplugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received event network-vif-plugged-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] No waiting events found dispatching network-vif-plugged-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:24:06 user nova-compute[71482]: WARNING nova.compute.manager [req-f3f6b28b-1953-468b-a9cc-4abcd0045324 req-2879440c-9af5-42a1-b7d0-06bb7629a867 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received unexpected event network-vif-plugged-1f40ed54-078b-4028-95a6-6b5788a57cad for instance with vm_state building and task_state spawning.
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Instance destroyed successfully.
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291446.5530262, d64edc05-fbf3-4f89-908f-ca221919c596 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] VM Resumed (Lifecycle Event)
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'resources' on Instance uuid 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1045691490',display_name='tempest-ServerRescueNegativeTestJSON-server-1045691490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1045691490',id=21,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRFQGCKpi8fjGcdpMDws7TZ+hZpwQGB4rtL60LdXbaRXqJvmTcXhTPGYdQ+Z42mEAB4P05g7T0Z0J2ARvc+I4t9vDocY1CSO+itTj8pMWaDXEEILwFmJvFWolS0ihRs3g==',key_name='tempest-keypair-1774942187',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:19:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-i1bjiuzo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:21:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f6b983634234693ba04a3097c2a129b',uuid=0fe0c221-d660-4a7e-9fd8-5d9b49c659d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "address": "fa:16:3e:48:07:99", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0e06b9c-27", "ovs_interfaceid": "a0e06b9c-27fc-47a2-a5d1-0da741a09eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:07:99,bridge_name='br-int',has_traffic_filtering=True,id=a0e06b9c-27fc-47a2-a5d1-0da741a09eaa,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e06b9c-27') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG os_vif [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:07:99,bridge_name='br-int',has_traffic_filtering=True,id=a0e06b9c-27fc-47a2-a5d1-0da741a09eaa,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e06b9c-27') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0e06b9c-27, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:24:06 user nova-compute[71482]: INFO os_vif [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:07:99,bridge_name='br-int',has_traffic_filtering=True,id=a0e06b9c-27fc-47a2-a5d1-0da741a09eaa,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0e06b9c-27')
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Deleting instance files /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0_del
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Deletion of /opt/stack/data/nova/instances/0fe0c221-d660-4a7e-9fd8-5d9b49c659d0_del complete
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Instance spawned successfully.
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291446.5592015, d64edc05-fbf3-4f89-908f-ca221919c596 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] VM Started (Lifecycle Event)
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Took 5.69 seconds to spawn the instance on the hypervisor.
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.compute.manager [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Took 1.04 seconds to destroy the instance on the hypervisor.
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:06 user nova-compute[71482]: INFO nova.compute.manager [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Took 6.42 seconds to build instance.
Apr 12 09:24:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9a846500-a01b-4971-b7e5-02704eb9a6f1 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.517s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291433.2243795, 25232386-f51a-434b-9280-c4dd30b55f3d => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:24:08 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] VM Stopped (Lifecycle Event)
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-deleted-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:24:08 user nova-compute[71482]: INFO nova.compute.manager [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Neutron deleted interface a0e06b9c-27fc-47a2-a5d1-0da741a09eaa; detaching it from the instance and deleting it from the info cache
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.network.neutron [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] Acquiring lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] No waiting events found dispatching network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:24:08 user nova-compute[71482]: WARNING nova.compute.manager [req-114185e8-8620-4baa-88d0-415fe673baed req-de0880c2-a3f7-499b-a25f-de91b7a54f1e service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Received unexpected event network-vif-plugged-a0e06b9c-27fc-47a2-a5d1-0da741a09eaa for instance with vm_state active and task_state deleting.
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-954700f8-081d-4f30-a37f-5dbd3774b24c None None] [instance: 25232386-f51a-434b-9280-c4dd30b55f3d] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:24:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:24:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=7896MB free_disk=26.16067886352539GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:08 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Took 1.53 seconds to deallocate network for instance.
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-6b06833a-f0f3-4018-b447-1c31186c07af req-19fe02ef-f020-45b9-bc88-e9c97c755a48 service nova] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Detach interface failed, port_id=a0e06b9c-27fc-47a2-a5d1-0da741a09eaa, reason: Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e442604c-86f4-45e1-9407-1764133852ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 825afa91-cf8c-477a-afbf-40af95b81c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 2f60c685-1b91-4700-aa57-a4a272ea166a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d64edc05-fbf3-4f89-908f-ca221919c596 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.414s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:09 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:24:09 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:24:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:09 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Deleted allocations for instance 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0
Apr 12 09:24:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f1544710-d5f0-4b81-bb7e-0902c3bc768c tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "0fe0c221-d660-4a7e-9fd8-5d9b49c659d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.534s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:21 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291446.5466359, 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:24:21 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] VM Stopped (Lifecycle Event)
Apr 12 09:24:21 user nova-compute[71482]: DEBUG nova.compute.manager [None req-42eb76ef-ba39-4977-b77c-dd443b750151 None None] [instance: 0fe0c221-d660-4a7e-9fd8-5d9b49c659d0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:24:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:24:46 user nova-compute[71482]: INFO nova.compute.claims [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Claim successful on node user
Apr 12 09:24:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:24:47 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.policy [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd76daece06a943668e6c1c3c2c57ebaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ebfa64bb5194b859821a77de6805d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:24:47 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Creating image(s)
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.156s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk 1073741824" returned: 0 in 0.049s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Cannot resize image /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'migration_context' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Ensure instance console log exists: /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Successfully created port: 2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:24:48 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Successfully updated port: 2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:24:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:24:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquired lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:24:48 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:24:48 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:24:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-changed-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:24:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Refreshing instance network info cache due to event network-changed-2c0316e9-6065-4c8c-8e7d-8d02f54d0083. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:24:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] Acquiring lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.network.neutron [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updating instance_info_cache with network_info: [{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Releasing lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance network_info: |[{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] Acquired lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.network.neutron [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Refreshing network info cache for port 2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Start _get_guest_xml network_info=[{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:24:49 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:24:49 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368249722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368249722',id=29,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5L2YPZ2KVlhG6oFOZGGwTxHh7VmuiAaOSH0We/vpq8fOiO1mNYzg6+tMndipazXRpul18uCeRgGch/My5l++MyiqK2qEK0kNajHsUhulUGdS/XiM9WXRLjaM3kVzoxA==',key_name='tempest-keypair-202654117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-i7mje20m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:24:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=8a52d45c-9ce4-4e4f-973a-fffce9f85bef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:24:49 user nova-compute[71482]:   <uuid>8a52d45c-9ce4-4e4f-973a-fffce9f85bef</uuid>
Apr 12 09:24:49 user nova-compute[71482]:   <name>instance-0000001d</name>
Apr 12 09:24:49 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:24:49 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:24:49 user nova-compute[71482]:   <metadata>
Apr 12 09:24:49 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:24:49 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:24:49 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-368249722</nova:name>
Apr 12 09:24:49 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:24:49</nova:creationTime>
Apr 12 09:24:49 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:24:49 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:24:49 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:24:49 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:24:49 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:24:49 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:24:49 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:24:49 user nova-compute[71482]:       <nova:owner>
Apr 12 09:24:49 user nova-compute[71482]:         <nova:user uuid="d76daece06a943668e6c1c3c2c57ebaa">tempest-AttachVolumeShelveTestJSON-72439030-project-member</nova:user>
Apr 12 09:24:49 user nova-compute[71482]:         <nova:project uuid="6ebfa64bb5194b859821a77de6805d2d">tempest-AttachVolumeShelveTestJSON-72439030</nova:project>
Apr 12 09:24:49 user nova-compute[71482]:       </nova:owner>
Apr 12 09:24:49 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:24:49 user nova-compute[71482]:       <nova:ports>
Apr 12 09:24:49 user nova-compute[71482]:         <nova:port uuid="2c0316e9-6065-4c8c-8e7d-8d02f54d0083">
Apr 12 09:24:49 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 09:24:49 user nova-compute[71482]:         </nova:port>
Apr 12 09:24:49 user nova-compute[71482]:       </nova:ports>
Apr 12 09:24:49 user nova-compute[71482]:     </nova:instance>
Apr 12 09:24:49 user nova-compute[71482]:   </metadata>
Apr 12 09:24:49 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:24:49 user nova-compute[71482]:     <system>
Apr 12 09:24:49 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:24:49 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:24:49 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:24:49 user nova-compute[71482]:       <entry name="serial">8a52d45c-9ce4-4e4f-973a-fffce9f85bef</entry>
Apr 12 09:24:49 user nova-compute[71482]:       <entry name="uuid">8a52d45c-9ce4-4e4f-973a-fffce9f85bef</entry>
Apr 12 09:24:49 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:24:49 user nova-compute[71482]:     </system>
Apr 12 09:24:49 user nova-compute[71482]:   </sysinfo>
Apr 12 09:24:49 user nova-compute[71482]:   <os>
Apr 12 09:24:49 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:24:49 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:24:49 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:24:49 user nova-compute[71482]:   </os>
Apr 12 09:24:49 user nova-compute[71482]:   <features>
Apr 12 09:24:49 user nova-compute[71482]:     <acpi/>
Apr 12 09:24:49 user nova-compute[71482]:     <apic/>
Apr 12 09:24:49 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:24:49 user nova-compute[71482]:   </features>
Apr 12 09:24:49 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:24:49 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:24:49 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:24:49 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:24:49 user nova-compute[71482]:   </clock>
Apr 12 09:24:49 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:24:49 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:24:49 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:24:49 user nova-compute[71482]:   </cpu>
Apr 12 09:24:49 user nova-compute[71482]:   <devices>
Apr 12 09:24:49 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:24:49 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:24:49 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk"/>
Apr 12 09:24:49 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:24:49 user nova-compute[71482]:     </disk>
Apr 12 09:24:49 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:24:49 user nova-compute[71482]:       <mac address="fa:16:3e:27:9c:2b"/>
Apr 12 09:24:49 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:24:49 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:24:49 user nova-compute[71482]:       <target dev="tap2c0316e9-60"/>
Apr 12 09:24:49 user nova-compute[71482]:     </interface>
Apr 12 09:24:49 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:24:49 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/console.log" append="off"/>
Apr 12 09:24:49 user nova-compute[71482]:     </serial>
Apr 12 09:24:49 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:24:49 user nova-compute[71482]:     <video>
Apr 12 09:24:49 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:24:49 user nova-compute[71482]:     </video>
Apr 12 09:24:49 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:24:49 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:24:49 user nova-compute[71482]:     </rng>
Apr 12 09:24:49 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:24:49 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:24:49 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:24:49 user nova-compute[71482]:     </memballoon>
Apr 12 09:24:49 user nova-compute[71482]:   </devices>
Apr 12 09:24:49 user nova-compute[71482]: </domain>
Apr 12 09:24:49 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368249722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368249722',id=29,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5L2YPZ2KVlhG6oFOZGGwTxHh7VmuiAaOSH0We/vpq8fOiO1mNYzg6+tMndipazXRpul18uCeRgGch/My5l++MyiqK2qEK0kNajHsUhulUGdS/XiM9WXRLjaM3kVzoxA==',key_name='tempest-keypair-202654117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-i7mje20m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:24:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=8a52d45c-9ce4-4e4f-973a-fffce9f85bef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG os_vif [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c0316e9-60, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c0316e9-60, col_values=(('external_ids', {'iface-id': '2c0316e9-6065-4c8c-8e7d-8d02f54d0083', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:9c:2b', 'vm-uuid': '8a52d45c-9ce4-4e4f-973a-fffce9f85bef'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:49 user nova-compute[71482]: INFO os_vif [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60')
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] No VIF found with MAC fa:16:3e:27:9c:2b, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.network.neutron [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updated VIF entry in instance network info cache for port 2c0316e9-6065-4c8c-8e7d-8d02f54d0083. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG nova.network.neutron [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updating instance_info_cache with network_info: [{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:24:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35503c09-04b0-40d4-8640-63e14c8ad194 req-571343d0-38b0-4f9f-be2f-125cbad6e410 service nova] Releasing lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:24:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:24:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] No waiting events found dispatching network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:24:50 user nova-compute[71482]: WARNING nova.compute.manager [req-da5a6c13-e7dd-48a2-99ea-dfa69383266d req-6a5748f0-3397-4c38-bde1-698198262f9d service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received unexpected event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance with vm_state building and task_state spawning.
Apr 12 09:24:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] No waiting events found dispatching network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:24:52 user nova-compute[71482]: WARNING nova.compute.manager [req-7f576016-1b9f-43a1-a4d5-b9da9019ae80 req-0d5aba2d-d3e1-4fb7-8af9-f903c7071b8f service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received unexpected event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance with vm_state building and task_state spawning.
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291492.95061, 8a52d45c-9ce4-4e4f-973a-fffce9f85bef => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:24:52 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] VM Resumed (Lifecycle Event)
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:24:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance spawned successfully.
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:24:53 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:24:53 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291492.9517605, 8a52d45c-9ce4-4e4f-973a-fffce9f85bef => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:24:53 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] VM Started (Lifecycle Event)
Apr 12 09:24:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:24:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:24:53 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:24:53 user nova-compute[71482]: INFO nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Took 5.89 seconds to spawn the instance on the hypervisor.
Apr 12 09:24:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:24:53 user nova-compute[71482]: INFO nova.compute.manager [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Took 6.61 seconds to build instance.
Apr 12 09:24:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3d31ab60-f84e-43be-9151-332d48383adf tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.714s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:24:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:24:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:24:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:24:53 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:24:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:54 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updating instance_info_cache with network_info: [{"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:24:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-e2070294-eb8a-4ee9-a4b5-baab508d8744" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:24:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:24:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:55 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:55 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:24:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:24:59 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:59 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:24:59 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:24:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:01 user nova-compute[71482]: INFO nova.compute.manager [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Terminating instance
Apr 12 09:25:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-unplugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] No waiting events found dispatching network-vif-unplugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-97980773-e959-4542-8351-5d98362452e1 req-0c3cc47b-82b1-473c-8aee-d73c61e7b7f8 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-unplugged-44c4d894-3c30-4528-95cd-37f612257156 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Instance destroyed successfully.
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'resources' on Instance uuid 6f58bf6a-beec-40e5-b8be-de03539038f8 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1967968381',display_name='tempest-ServerRescueNegativeTestJSON-server-1967968381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1967968381',id=6,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:10:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-0hs4rd5w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:10:56Z,user_data=None,user_id='7f6b983634234693ba04a3097c2a129b',uuid=6f58bf6a-beec-40e5-b8be-de03539038f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "44c4d894-3c30-4528-95cd-37f612257156", "address": "fa:16:3e:04:2d:9f", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44c4d894-3c", "ovs_interfaceid": "44c4d894-3c30-4528-95cd-37f612257156", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4d894-3c30-4528-95cd-37f612257156,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4d894-3c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG os_vif [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4d894-3c30-4528-95cd-37f612257156,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4d894-3c') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44c4d894-3c, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:25:02 user nova-compute[71482]: INFO os_vif [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:9f,bridge_name='br-int',has_traffic_filtering=True,id=44c4d894-3c30-4528-95cd-37f612257156,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap44c4d894-3c')
Apr 12 09:25:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Deleting instance files /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8_del
Apr 12 09:25:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Deletion of /opt/stack/data/nova/instances/6f58bf6a-beec-40e5-b8be-de03539038f8_del complete
Apr 12 09:25:02 user nova-compute[71482]: INFO nova.compute.manager [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 12 09:25:02 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-deleted-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:02 user nova-compute[71482]: INFO nova.compute.manager [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Neutron deleted interface 44c4d894-3c30-4528-95cd-37f612257156; detaching it from the instance and deleting it from the info cache
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.network.neutron [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:02 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Took 0.53 seconds to deallocate network for instance.
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-0225e124-d092-4bd0-bf58-e6a69f8afd9d req-0c396783-d444-4652-a57c-831109a476f3 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Detach interface failed, port_id=44c4d894-3c30-4528-95cd-37f612257156, reason: Instance 6f58bf6a-beec-40e5-b8be-de03539038f8 could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:02 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:03 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Deleted allocations for instance 6f58bf6a-beec-40e5-b8be-de03539038f8
Apr 12 09:25:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e29cc38-36a0-4256-85b6-4386278fabd3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] Acquiring lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] Lock "6f58bf6a-beec-40e5-b8be-de03539038f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] No waiting events found dispatching network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:03 user nova-compute[71482]: WARNING nova.compute.manager [req-49a021e6-6500-42f9-941d-0c598b229560 req-d4254c8e-04aa-47ce-b16e-68c8ef612d83 service nova] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Received unexpected event network-vif-plugged-44c4d894-3c30-4528-95cd-37f612257156 for instance with vm_state deleted and task_state None.
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received event network-changed-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Refreshing instance network info cache due to event network-changed-0ea8781f-860c-4135-8264-ad52a792fa55. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] Acquiring lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] Acquired lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG nova.network.neutron [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Refreshing network info cache for port 0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG nova.network.neutron [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updated VIF entry in instance network info cache for port 0ea8781f-860c-4135-8264-ad52a792fa55. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG nova.network.neutron [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updating instance_info_cache with network_info: [{"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9d474e5f-5c13-4fd8-82b3-e36ada9916d0 req-dae2e6b5-7d7e-4476-a544-31352ed0bcda service nova] Releasing lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:25:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8034MB free_disk=26.17685317993164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e442604c-86f4-45e1-9407-1764133852ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 825afa91-cf8c-477a-afbf-40af95b81c76 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 2f60c685-1b91-4700-aa57-a4a272ea166a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d64edc05-fbf3-4f89-908f-ca221919c596 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:25:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:25:09 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:25:09 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:25:09 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:25:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:25:10 user nova-compute[71482]: INFO nova.compute.claims [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Claim successful on node user
Apr 12 09:25:10 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:25:10 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:25:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:25:10 user nova-compute[71482]: INFO nova.virt.block_device [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Booting with volume da73130e-1f1c-40e7-9961-d5b661f114a2 at /dev/vda
Apr 12 09:25:10 user nova-compute[71482]: DEBUG nova.policy [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '375db5b9a80244d3878822049230ba47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20b8c89c46bb460f9f94be9426a22bb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG os_brick.utils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc2e4c1-32cd-4b1e-a848-f4f4515c9c0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7527c51b-76c3-4e90-8394-198f0f4bff68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e4c4a0-c35e-47c3-855a-441d9010896b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[20abb1a5-aba9-4876-9fe9-7194f0c29426]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:25:11 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:25:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8139d0-9313-4c09-ae87-a2cd8e4d8fd8]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG os_brick.utils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating existing volume attachment record: 98a3ab69-ce9f-48f1-b917-c57149ea74c6 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:25:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Successfully created port: d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG nova.network.neutron [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Successfully updated port: d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG nova.network.neutron [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-changed-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Refreshing instance network info cache due to event network-changed-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] Acquiring lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG nova.network.neutron [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG nova.network.neutron [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating instance_info_cache with network_info: [{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Instance network_info: |[{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] Acquired lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:25:12 user nova-compute[71482]: DEBUG nova.network.neutron [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Refreshing network info cache for port d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:25:13 user nova-compute[71482]: DEBUG nova.network.neutron [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updated VIF entry in instance network info cache for port d6dffcd5-fc3c-47e6-a72e-22d72ab3a406. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:25:13 user nova-compute[71482]: DEBUG nova.network.neutron [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating instance_info_cache with network_info: [{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4f3b1340-ca44-41b9-9750-d8e5f400b44f req-42195eeb-ffef-49fb-9b3a-15407b2df318 service nova] Releasing lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:25:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:25:15 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Creating image(s)
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Ensure instance console log exists: /opt/stack/data/nova/instances/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Start _get_guest_xml network_info=[{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '98a3ab69-ce9f-48f1-b917-c57149ea74c6', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmQZiMUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6720b589-6dc8-460a-bdc2-52b9b1cd77fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'da73130e-1f1c-40e7-9961-d5b661f114a2', 'serial': 'da73130e-1f1c-40e7-9961-d5b661f114a2'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:25:15 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:25:15 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmQZiMUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:25:15 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:25:15 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:25:15 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[347f22ad-95b3-4c89-8056-c5f8858d1233]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:25:15 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab22236d-30fd-412b-b918-b8338770ffb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2] added
Apr 12 09:25:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a9d18d-8050-49fb-a7e0-c9bc8ae9d039]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[849b19a7-dc49-4994-bc47-ecb74384a538]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmQZiMUS {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmQZiMUS" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4363e684-2d6e-4da6-8e8a-bad5a5686ce6]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CmQZiMUS'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea82066-384b-4761-8244-f70f6dffbf63]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1897be-ff20-43cf-8385-c06b0f329ab9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:15 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:25:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:15 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:25:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d70a442-9111-4fe0-907b-a4531f9830a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260]
Apr 12 09:25:15 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260] successful.
Apr 12 09:25:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a6de32-59f4-42f4-b4d6-e74e9dd22af0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb823c-133d-4b13-a4af-13f544d30f8d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:15 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:25:15 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:25:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:15 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:25:15 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:25:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[984696d3-98c4-42e8-bc9e-709a30d49fd1]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:25:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmQZiMUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23762343237323836', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762343237323836', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-310903129',display_name='tempest-ServerActionsTestJSON-server-310903129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-310903129',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-0yzal2xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=6720b589-6dc8-460a-bdc2-52b9b1cd77fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.objects.instance [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'pci_devices' on Instance uuid 6720b589-6dc8-460a-bdc2-52b9b1cd77fb {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:25:16 user nova-compute[71482]:   <uuid>6720b589-6dc8-460a-bdc2-52b9b1cd77fb</uuid>
Apr 12 09:25:16 user nova-compute[71482]:   <name>instance-0000001e</name>
Apr 12 09:25:16 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:25:16 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:25:16 user nova-compute[71482]:   <metadata>
Apr 12 09:25:16 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:25:16 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:25:16 user nova-compute[71482]:       <nova:name>tempest-ServerActionsTestJSON-server-310903129</nova:name>
Apr 12 09:25:16 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:25:15</nova:creationTime>
Apr 12 09:25:16 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:25:16 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:25:16 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:25:16 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:25:16 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:25:16 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:25:16 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:25:16 user nova-compute[71482]:       <nova:owner>
Apr 12 09:25:16 user nova-compute[71482]:         <nova:user uuid="375db5b9a80244d3878822049230ba47">tempest-ServerActionsTestJSON-1142062861-project-member</nova:user>
Apr 12 09:25:16 user nova-compute[71482]:         <nova:project uuid="20b8c89c46bb460f9f94be9426a22bb8">tempest-ServerActionsTestJSON-1142062861</nova:project>
Apr 12 09:25:16 user nova-compute[71482]:       </nova:owner>
Apr 12 09:25:16 user nova-compute[71482]:       <nova:ports>
Apr 12 09:25:16 user nova-compute[71482]:         <nova:port uuid="d6dffcd5-fc3c-47e6-a72e-22d72ab3a406">
Apr 12 09:25:16 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:25:16 user nova-compute[71482]:         </nova:port>
Apr 12 09:25:16 user nova-compute[71482]:       </nova:ports>
Apr 12 09:25:16 user nova-compute[71482]:     </nova:instance>
Apr 12 09:25:16 user nova-compute[71482]:   </metadata>
Apr 12 09:25:16 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:25:16 user nova-compute[71482]:     <system>
Apr 12 09:25:16 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:25:16 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:25:16 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:25:16 user nova-compute[71482]:       <entry name="serial">6720b589-6dc8-460a-bdc2-52b9b1cd77fb</entry>
Apr 12 09:25:16 user nova-compute[71482]:       <entry name="uuid">6720b589-6dc8-460a-bdc2-52b9b1cd77fb</entry>
Apr 12 09:25:16 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:25:16 user nova-compute[71482]:     </system>
Apr 12 09:25:16 user nova-compute[71482]:   </sysinfo>
Apr 12 09:25:16 user nova-compute[71482]:   <os>
Apr 12 09:25:16 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:25:16 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:25:16 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:25:16 user nova-compute[71482]:   </os>
Apr 12 09:25:16 user nova-compute[71482]:   <features>
Apr 12 09:25:16 user nova-compute[71482]:     <acpi/>
Apr 12 09:25:16 user nova-compute[71482]:     <apic/>
Apr 12 09:25:16 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:25:16 user nova-compute[71482]:   </features>
Apr 12 09:25:16 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:25:16 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:25:16 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:25:16 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:25:16 user nova-compute[71482]:   </clock>
Apr 12 09:25:16 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:25:16 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:25:16 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:25:16 user nova-compute[71482]:   </cpu>
Apr 12 09:25:16 user nova-compute[71482]:   <devices>
Apr 12 09:25:16 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:25:16 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:25:16 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:25:16 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:25:16 user nova-compute[71482]:       <serial>da73130e-1f1c-40e7-9961-d5b661f114a2</serial>
Apr 12 09:25:16 user nova-compute[71482]:     </disk>
Apr 12 09:25:16 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:25:16 user nova-compute[71482]:       <mac address="fa:16:3e:b5:91:cc"/>
Apr 12 09:25:16 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:25:16 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:25:16 user nova-compute[71482]:       <target dev="tapd6dffcd5-fc"/>
Apr 12 09:25:16 user nova-compute[71482]:     </interface>
Apr 12 09:25:16 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:25:16 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/console.log" append="off"/>
Apr 12 09:25:16 user nova-compute[71482]:     </serial>
Apr 12 09:25:16 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:25:16 user nova-compute[71482]:     <video>
Apr 12 09:25:16 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:25:16 user nova-compute[71482]:     </video>
Apr 12 09:25:16 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:25:16 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:25:16 user nova-compute[71482]:     </rng>
Apr 12 09:25:16 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:25:16 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:25:16 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:25:16 user nova-compute[71482]:     </memballoon>
Apr 12 09:25:16 user nova-compute[71482]:   </devices>
Apr 12 09:25:16 user nova-compute[71482]: </domain>
Apr 12 09:25:16 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-310903129',display_name='tempest-ServerActionsTestJSON-server-310903129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-310903129',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-0yzal2xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:25:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=6720b589-6dc8-460a-bdc2-52b9b1cd77fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG os_vif [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6dffcd5-fc, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6dffcd5-fc, col_values=(('external_ids', {'iface-id': 'd6dffcd5-fc3c-47e6-a72e-22d72ab3a406', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:91:cc', 'vm-uuid': '6720b589-6dc8-460a-bdc2-52b9b1cd77fb'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:16 user nova-compute[71482]: INFO os_vif [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc')
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:25:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No VIF found with MAC fa:16:3e:b5:91:cc, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:25:17 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291502.178973, 6f58bf6a-beec-40e5-b8be-de03539038f8 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:25:17 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] VM Stopped (Lifecycle Event)
Apr 12 09:25:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-839746ed-f254-45fc-8d8c-9bc851aac0e1 None None] [instance: 6f58bf6a-beec-40e5-b8be-de03539038f8] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] No waiting events found dispatching network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:18 user nova-compute[71482]: WARNING nova.compute.manager [req-9f40cb40-e74c-474e-9822-6e0e69b4e81e req-53636c8e-b6b3-4a1d-966a-f2f1a64e4fd0 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received unexpected event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance with vm_state building and task_state spawning.
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291520.1803586, 6720b589-6dc8-460a-bdc2-52b9b1cd77fb => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:25:20 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] VM Resumed (Lifecycle Event)
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:25:20 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Instance spawned successfully.
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:25:20 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291520.1839008, 6720b589-6dc8-460a-bdc2-52b9b1cd77fb => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:25:20 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] VM Started (Lifecycle Event)
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:25:20 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:25:20 user nova-compute[71482]: INFO nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Took 4.92 seconds to spawn the instance on the hypervisor.
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:25:20 user nova-compute[71482]: INFO nova.compute.manager [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Took 10.01 seconds to build instance.
Apr 12 09:25:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-355d534f-c6be-4378-9f0f-aae115d15832 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.103s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] No waiting events found dispatching network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:20 user nova-compute[71482]: WARNING nova.compute.manager [req-c162be62-5d26-40a4-9451-4162e5605f1b req-4c4f6604-09ae-4feb-ba42-916113889b37 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received unexpected event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance with vm_state active and task_state None.
Apr 12 09:25:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "2f60c685-1b91-4700-aa57-a4a272ea166a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:27 user nova-compute[71482]: INFO nova.compute.manager [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Terminating instance
Apr 12 09:25:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:25:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received event network-vif-unplugged-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] Acquiring lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] No waiting events found dispatching network-vif-unplugged-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-9461a6b2-a16c-4932-a54d-528136bcc96d req-ade8099d-57c1-446d-a4da-cd4d1ea013a5 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received event network-vif-unplugged-3e8de34b-35fa-429c-8449-262a4b6c37cd for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:25:28 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Instance destroyed successfully.
Apr 12 09:25:28 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lazy-loading 'resources' on Instance uuid 2f60c685-1b91-4700-aa57-a4a272ea166a {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-623755002',display_name='tempest-VolumesActionsTest-instance-623755002',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-623755002',id=27,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f752416df0d043a4b82b204a780f597c',ramdisk_id='',reservation_id='r-ad8qxi0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-902475152',owner_user_name='tempest-VolumesActionsTest-902475152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:23:44Z,user_data=None,user_id='e432c3374fe34540b47999d4cc361e0e',uuid=2f60c685-1b91-4700-aa57-a4a272ea166a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converting VIF {"id": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "address": "fa:16:3e:99:b6:b5", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e8de34b-35", "ovs_interfaceid": "3e8de34b-35fa-429c-8449-262a4b6c37cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:b6:b5,bridge_name='br-int',has_traffic_filtering=True,id=3e8de34b-35fa-429c-8449-262a4b6c37cd,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8de34b-35') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG os_vif [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b6:b5,bridge_name='br-int',has_traffic_filtering=True,id=3e8de34b-35fa-429c-8449-262a4b6c37cd,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8de34b-35') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e8de34b-35, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:25:28 user nova-compute[71482]: INFO os_vif [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:b6:b5,bridge_name='br-int',has_traffic_filtering=True,id=3e8de34b-35fa-429c-8449-262a4b6c37cd,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e8de34b-35')
Apr 12 09:25:28 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Deleting instance files /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a_del
Apr 12 09:25:28 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Deletion of /opt/stack/data/nova/instances/2f60c685-1b91-4700-aa57-a4a272ea166a_del complete
Apr 12 09:25:28 user nova-compute[71482]: INFO nova.compute.manager [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Took 0.68 seconds to destroy the instance on the hypervisor.
Apr 12 09:25:28 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:25:28 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:25:29 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:29 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Took 0.64 seconds to deallocate network for instance.
Apr 12 09:25:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received event network-vif-deleted-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:29 user nova-compute[71482]: INFO nova.compute.manager [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Neutron deleted interface 3e8de34b-35fa-429c-8449-262a4b6c37cd; detaching it from the instance and deleting it from the info cache
Apr 12 09:25:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-563aee85-2c4d-4bdb-9d75-d08bd092dc69 req-cc0690b9-65e0-4767-b675-398f4cc538a4 service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Detach interface failed, port_id=3e8de34b-35fa-429c-8449-262a4b6c37cd, reason: Instance 2f60c685-1b91-4700-aa57-a4a272ea166a could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:25:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:29 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:25:29 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:25:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:29 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Deleted allocations for instance 2f60c685-1b91-4700-aa57-a4a272ea166a
Apr 12 09:25:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a89b67de-0710-433e-8441-57a81a1f65d3 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.859s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received event network-vif-plugged-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] Acquiring lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] Lock "2f60c685-1b91-4700-aa57-a4a272ea166a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] No waiting events found dispatching network-vif-plugged-3e8de34b-35fa-429c-8449-262a4b6c37cd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:30 user nova-compute[71482]: WARNING nova.compute.manager [req-1c476f9f-b169-4d1e-a4a2-98e00a0c727b req-a2be5e2e-0c07-45a8-bb50-3e76d8eba6ab service nova] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Received unexpected event network-vif-plugged-3e8de34b-35fa-429c-8449-262a4b6c37cd for instance with vm_state deleted and task_state None.
Apr 12 09:25:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "825afa91-cf8c-477a-afbf-40af95b81c76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:40 user nova-compute[71482]: INFO nova.compute.manager [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Terminating instance
Apr 12 09:25:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:25:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-769e9448-3c47-4b13-b9e6-5a1beda9521d req-f89513a7-bcec-4c38-8a61-36e81e4fcb15 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-unplugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Instance destroyed successfully.
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.objects.instance [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'resources' on Instance uuid 825afa91-cf8c-477a-afbf-40af95b81c76 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:20:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1533143626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1533143626',id=24,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:22:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-ob0dtmdq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:23:55Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=825afa91-cf8c-477a-afbf-40af95b81c76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "address": "fa:16:3e:70:ac:21", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f71fe3-cf", "ovs_interfaceid": "99f71fe3-cfc5-48aa-99e5-7b826f7a9732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:ac:21,bridge_name='br-int',has_traffic_filtering=True,id=99f71fe3-cfc5-48aa-99e5-7b826f7a9732,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f71fe3-cf') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_vif [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:ac:21,bridge_name='br-int',has_traffic_filtering=True,id=99f71fe3-cfc5-48aa-99e5-7b826f7a9732,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f71fe3-cf') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99f71fe3-cf, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:25:41 user nova-compute[71482]: INFO os_vif [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:ac:21,bridge_name='br-int',has_traffic_filtering=True,id=99f71fe3-cfc5-48aa-99e5-7b826f7a9732,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f71fe3-cf')
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nMQfOprs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:25:41 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea153a37-9756-4851-aa78-c1c0dce368ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:25:41 user nova-compute[71482]: No targets found.
Apr 12 09:25:41 user nova-compute[71482]: iSNS:
Apr 12 09:25:41 user nova-compute[71482]: No targets found.
Apr 12 09:25:41 user nova-compute[71482]: STATIC:
Apr 12 09:25:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2
Apr 12 09:25:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:25:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:25:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d
Apr 12 09:25:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:25:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:25:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:25:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:25:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:25:41 user nova-compute[71482]: FIRMWARE:
Apr 12 09:25:41 user nova-compute[71482]: No targets found.
Apr 12 09:25:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:25:41 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:25:41 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a466a08e-61d6-4ec9-b66a-5ac6399a8d52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4e09b7-b753-42af-bb57-1738c1cf6b67]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:41 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:25:41 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:25:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:41 user nova-compute[71482]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d (non-flash)
Apr 12 09:25:41 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:25:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c1ca680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d'): ({'sdf'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Removing single pathed devices sdf {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c52fa51-5690-4f69-896d-988ca33fa816]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc8c7ea-e390-4717-8f37-2efc8da7f50c]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flushing IO for device /dev/sdf {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d32d7df-5088-4ed6-8e9a-35ec6fa0dc70]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3875cf-e5da-4da2-84b4-21b294ad4983]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] SCSI volumes sdf have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40bb180-6139-4069-84c2-eafb8ec5d410]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[199281ce-ecab-4fe2-8176-a721ac773cc1]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d, portal: 172.16.0.220,3260]
Apr 12 09:25:41 user nova-compute[71482]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d, portal: 172.16.0.220,3260] successful.
Apr 12 09:25:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:22ce6dbc-4a22-4480-8874-e107b53f518d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0482e048-bd5a-4875-a54e-55b129075084]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] <== disconnect_volume: return (312ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:25:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Deleting instance files /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76_del
Apr 12 09:25:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Deletion of /opt/stack/data/nova/instances/825afa91-cf8c-477a-afbf-40af95b81c76_del complete
Apr 12 09:25:41 user nova-compute[71482]: INFO nova.compute.manager [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 12 09:25:41 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:25:41 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:25:42 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:42 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Took 0.50 seconds to deallocate network for instance.
Apr 12 09:25:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-deleted-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:42 user nova-compute[71482]: INFO nova.compute.manager [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Neutron deleted interface 99f71fe3-cfc5-48aa-99e5-7b826f7a9732; detaching it from the instance and deleting it from the info cache
Apr 12 09:25:42 user nova-compute[71482]: DEBUG nova.network.neutron [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-16b9bddf-5ad6-40dc-9248-fc8c7fbda1ce req-4f6e4142-e8a7-445f-879f-cf7b0e2b6886 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Detach interface failed, port_id=99f71fe3-cfc5-48aa-99e5-7b826f7a9732, reason: Instance 825afa91-cf8c-477a-afbf-40af95b81c76 could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] Acquiring lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] Lock "825afa91-cf8c-477a-afbf-40af95b81c76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] No waiting events found dispatching network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:43 user nova-compute[71482]: WARNING nova.compute.manager [req-10829b2d-d45f-4afd-bbd5-76057039fede req-bdb4c09f-721f-4f93-9e32-a2c99240ef12 service nova] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Received unexpected event network-vif-plugged-99f71fe3-cfc5-48aa-99e5-7b826f7a9732 for instance with vm_state active and task_state deleting.
Apr 12 09:25:43 user nova-compute[71482]: INFO nova.compute.manager [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Took 0.79 seconds to detach 1 volumes for instance.
Apr 12 09:25:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291528.443716, 2f60c685-1b91-4700-aa57-a4a272ea166a => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:25:43 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] VM Stopped (Lifecycle Event)
Apr 12 09:25:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3aa5cdc8-3f2b-47e2-b6f1-689ac7e8f91a None None] [instance: 2f60c685-1b91-4700-aa57-a4a272ea166a] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:43 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Deleted allocations for instance 825afa91-cf8c-477a-afbf-40af95b81c76
Apr 12 09:25:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d1f5f917-1462-44d6-a133-5d43c056d61f tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "825afa91-cf8c-477a-afbf-40af95b81c76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.902s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received event network-changed-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Refreshing instance network info cache due to event network-changed-1f40ed54-078b-4028-95a6-6b5788a57cad. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] Acquiring lock "refresh_cache-d64edc05-fbf3-4f89-908f-ca221919c596" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] Acquired lock "refresh_cache-d64edc05-fbf3-4f89-908f-ca221919c596" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG nova.network.neutron [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Refreshing network info cache for port 1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG nova.network.neutron [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Updated VIF entry in instance network info cache for port 1f40ed54-078b-4028-95a6-6b5788a57cad. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG nova.network.neutron [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Updating instance_info_cache with network_info: [{"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:51 user nova-compute[71482]: INFO nova.compute.manager [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Terminating instance
Apr 12 09:25:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2bc8da72-e49e-494a-975a-7de32bc0b2a0 req-83592d27-68ac-4b5a-8eb2-f7e8abebe77f service nova] Releasing lock "refresh_cache-d64edc05-fbf3-4f89-908f-ca221919c596" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-unplugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-unplugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-1acf9279-7106-47f4-81dd-63ad91b982c6 req-b9d03e3a-b973-4b32-9f06-7fbd76e800bb service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-unplugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Instance destroyed successfully.
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lazy-loading 'resources' on Instance uuid 4a835849-83a7-457d-a96d-0acaa5a4a964 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1294510131',display_name='tempest-ServerRescueNegativeTestJSON-server-1294510131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1294510131',id=4,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:13:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1c3cc8ab6ab244b1badb6fea347d64ea',ramdisk_id='',reservation_id='r-fq7jpw7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-480181232',owner_user_name='tempest-ServerRescueNegativeTestJSON-480181232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:15:39Z,user_data=None,user_id='7f6b983634234693ba04a3097c2a129b',uuid=4a835849-83a7-457d-a96d-0acaa5a4a964,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converting VIF {"id": "a9c92ca6-773e-40e3-ab31-710b4b495183", "address": "fa:16:3e:4b:70:8c", "network": {"id": "699e7817-78bb-4ca0-bc59-8dd53b630c9b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-226938889-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1c3cc8ab6ab244b1badb6fea347d64ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9c92ca6-77", "ovs_interfaceid": "a9c92ca6-773e-40e3-ab31-710b4b495183", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a9c92ca6-773e-40e3-ab31-710b4b495183,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c92ca6-77') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG os_vif [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a9c92ca6-773e-40e3-ab31-710b4b495183,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c92ca6-77') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9c92ca6-77, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:52 user nova-compute[71482]: INFO os_vif [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:70:8c,bridge_name='br-int',has_traffic_filtering=True,id=a9c92ca6-773e-40e3-ab31-710b4b495183,network=Network(699e7817-78bb-4ca0-bc59-8dd53b630c9b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9c92ca6-77')
Apr 12 09:25:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Deleting instance files /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964_del
Apr 12 09:25:52 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Deletion of /opt/stack/data/nova/instances/4a835849-83a7-457d-a96d-0acaa5a4a964_del complete
Apr 12 09:25:52 user nova-compute[71482]: INFO nova.compute.manager [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Took 0.83 seconds to destroy the instance on the hypervisor.
Apr 12 09:25:52 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'flavor' on Instance uuid d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:52 user nova-compute[71482]: INFO nova.compute.manager [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Attaching volume 0d299f12-59f6-4fcc-8780-8edb75277242 to /dev/vdb
Apr 12 09:25:53 user nova-compute[71482]: DEBUG os_brick.utils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4321d70f-7c26-4a8c-9391-101f44be2ae5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dbb009-043b-4d5e-9ae9-f389510ea5cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f408b15f-978c-4587-a4cf-d13a98f02a46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e4850f-9aca-4351-a743-684877da8a21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:25:53 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e67ae47-b720-4675-9594-65f56d6177f9]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG os_brick.utils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Updating existing volume attachment record: 506576d7-2b72-40e5-af10-c620de81a25f {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-deleted-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:53 user nova-compute[71482]: INFO nova.compute.manager [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Neutron deleted interface a9c92ca6-773e-40e3-ab31-710b4b495183; detaching it from the instance and deleting it from the info cache
Apr 12 09:25:53 user nova-compute[71482]: DEBUG nova.network.neutron [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:53 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Took 0.52 seconds to deallocate network for instance.
Apr 12 09:25:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-4150838e-6f54-4c05-9a8f-33d00bf13582 req-fc6e577f-e178-4ddb-8bd2-2873b7a14c84 service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Detach interface failed, port_id=a9c92ca6-773e-40e3-ab31-710b4b495183, reason: Instance 4a835849-83a7-457d-a96d-0acaa5a4a964 could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:53 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Deleted allocations for instance 4a835849-83a7-457d-a96d-0acaa5a4a964
Apr 12 09:25:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-87d50ee6-feaa-42ea-976b-5f6756e031f3 tempest-ServerRescueNegativeTestJSON-480181232 tempest-ServerRescueNegativeTestJSON-480181232-project-member] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.862s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-e442604c-86f4-45e1-9407-1764133852ef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-e442604c-86f4-45e1-9407-1764133852ef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG nova.compute.manager [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] Acquiring lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] Lock "4a835849-83a7-457d-a96d-0acaa5a4a964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG nova.compute.manager [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] No waiting events found dispatching network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:25:54 user nova-compute[71482]: WARNING nova.compute.manager [req-449c7056-467e-4015-bb01-ac313f1cd4ac req-9e032f5d-b094-483e-bb52-7ffe8f258b0a service nova] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Received unexpected event network-vif-plugged-a9c92ca6-773e-40e3-ab31-710b4b495183 for instance with vm_state deleted and task_state None.
Apr 12 09:25:54 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] Updating instance_info_cache with network_info: [{"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-e442604c-86f4-45e1-9407-1764133852ef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:55 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:55 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:25:56 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291541.5355134, 825afa91-cf8c-477a-afbf-40af95b81c76 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:25:56 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] VM Stopped (Lifecycle Event)
Apr 12 09:25:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-338d33b2-b9d8-45fc-bc03-ea81fdebaf4a None None] [instance: 825afa91-cf8c-477a-afbf-40af95b81c76] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VArehdDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:25:57 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:25:57 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:25:57 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[502c751f-174c-4c85-88ad-e1400ce45be7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:25:57 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e76dc1-3c64-4249-af11-9cd9bca7c419]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242] added
Apr 12 09:25:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf1522-1d6f-4167-9ba5-259f010b842e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3f1610-ed36-4e33-add9-bf669be3e279]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VArehdDo {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VArehdDo" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe8875d-69ae-441f-a088-8d14f6948f04]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VArehdDo'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54cd7f1-32de-48c6-afc9-1adb1a2f2934]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6951b2b0-ca70-4146-a3b4-17d53f09a78c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:57 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:25:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:57 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:25:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[875aa6b3-c59c-44d3-b492-34242e7a8f65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242, portal: 172.16.0.220,3260]
Apr 12 09:25:57 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242, portal: 172.16.0.220,3260] successful.
Apr 12 09:25:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45022e5d-e5de-4ee3-98dc-5be5367dbe13]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d51b3a9-f125-4c81-9db6-ee352f47e20e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:57 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:25:57 user nova-compute[71482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 (non-flash)
Apr 12 09:25:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:25:57 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:25:57 user nova-compute[71482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 (non-flash)
Apr 12 09:25:57 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9c2108-55d0-4a0b-9b07-5db826992f67]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:25:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:25:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:25:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VArehdDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:25:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:25:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23061346138373630', 'path': '/dev/sdd'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:25:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061346138373630', 'path': '/dev/sdd'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:25:58 user nova-compute[71482]: DEBUG nova.objects.instance [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'flavor' on Instance uuid d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:25:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:25:58 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:25:58 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:25:58 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:25:58 user nova-compute[71482]:   <serial>0d299f12-59f6-4fcc-8780-8edb75277242</serial>
Apr 12 09:25:58 user nova-compute[71482]: </disk>
Apr 12 09:25:58 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:25:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:25:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:25:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No VIF found with MAC fa:16:3e:e5:57:bd, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:25:59 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:25:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-655aaec2-8309-4de0-9bea-543f3ccba610 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.188s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:25:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:25:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:25:59 user nova-compute[71482]: INFO nova.compute.manager [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Detaching volume 0d299f12-59f6-4fcc-8780-8edb75277242
Apr 12 09:25:59 user nova-compute[71482]: INFO nova.virt.block_device [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Attempting to driver detach volume 0d299f12-59f6-4fcc-8780-8edb75277242 from mountpoint /dev/vdb
Apr 12 09:25:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Attempting to detach device vdb from instance d64edc05-fbf3-4f89-908f-ca221919c596 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:25:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:25:59 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:25:59 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:25:59 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:25:59 user nova-compute[71482]:   <serial>0d299f12-59f6-4fcc-8780-8edb75277242</serial>
Apr 12 09:25:59 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:25:59 user nova-compute[71482]: </disk>
Apr 12 09:25:59 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:25:59 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully detached device vdb from instance d64edc05-fbf3-4f89-908f-ca221919c596 from the persistent domain config.
Apr 12 09:25:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d64edc05-fbf3-4f89-908f-ca221919c596 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:25:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:25:59 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:25:59 user nova-compute[71482]:   <source dev="/dev/sdd"/>
Apr 12 09:25:59 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:25:59 user nova-compute[71482]:   <serial>0d299f12-59f6-4fcc-8780-8edb75277242</serial>
Apr 12 09:25:59 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:25:59 user nova-compute[71482]: </disk>
Apr 12 09:25:59 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681291560.2442136, d64edc05-fbf3-4f89-908f-ca221919c596 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:26:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully detached device vdb from instance d64edc05-fbf3-4f89-908f-ca221919c596 from the live domain config.
Apr 12 09:26:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VArehdDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:26:00 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e4f5a7-4b38-455b-ab30-60eb7023babf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:26:00 user nova-compute[71482]: No targets found.
Apr 12 09:26:00 user nova-compute[71482]: iSNS:
Apr 12 09:26:00 user nova-compute[71482]: No targets found.
Apr 12 09:26:00 user nova-compute[71482]: STATIC:
Apr 12 09:26:00 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2
Apr 12 09:26:00 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:26:00 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:26:00 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242
Apr 12 09:26:00 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:26:00 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:26:00 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:26:00 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:26:00 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:26:00 user nova-compute[71482]: FIRMWARE:
Apr 12 09:26:00 user nova-compute[71482]: No targets found.
Apr 12 09:26:00 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:26:00 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:26:00 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3004beb1-d704-4f0a-a885-2196a9f1b7d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08efce7-7b85-4582-acc4-326118220987]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:26:00 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:26:00 user nova-compute[71482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 (non-flash)
Apr 12 09:26:00 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:26:00 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:26:00 user nova-compute[71482]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 (non-flash)
Apr 12 09:26:00 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c1de560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242'): ({'sdd'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Removing single pathed devices sdd {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd45a6b5-270b-4d4d-9818-923b607648ee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38c9dc2-f2c1-4a2a-b2db-1b7d06fe1fcb]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flushing IO for device /dev/sdd {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eacea20-101b-4ec0-99d3-129b1a8fec3d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[32199bd9-0944-4bc7-b914-263fc8b970c4]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] SCSI volumes sdd have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaec265c-7e46-4069-8062-b5972de41ed2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c486d7-be5a-4ba2-8a39-bb1802892a2f]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242, portal: 172.16.0.220,3260]
Apr 12 09:26:00 user nova-compute[71482]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242, portal: 172.16.0.220,3260] successful.
Apr 12 09:26:00 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d299f12-59f6-4fcc-8780-8edb75277242 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d2e44c-9a6f-4cad-9420-e57c4fc09797]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] <== disconnect_volume: return (282ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:26:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:26:01 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'flavor' on Instance uuid d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:26:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f3c96b78-8ab6-4371-8cd4-5bbbcda14d41 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.563s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291552.616756, 4a835849-83a7-457d-a96d-0acaa5a4a964 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:26:07 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] VM Stopped (Lifecycle Event)
Apr 12 09:26:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9d1c1f5b-2cf4-47c8-8d15-5b1b7d7c112d None None] [instance: 4a835849-83a7-457d-a96d-0acaa5a4a964] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:26:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:26:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8174MB free_disk=26.211990356445312GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e442604c-86f4-45e1-9407-1764133852ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d64edc05-fbf3-4f89-908f-ca221919c596 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1408MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid a569c652-6b15-4244-b011-1d09fbdd4281 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid e442604c-86f4-45e1-9407-1764133852ef {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid d2be3178-85b4-4012-a7d0-2d8543a65a42 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid 6720b589-6dc8-460a-bdc2-52b9b1cd77fb {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "a569c652-6b15-4244-b011-1d09fbdd4281" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a569c652-6b15-4244-b011-1d09fbdd4281" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "e442604c-86f4-45e1-9407-1764133852ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "e442604c-86f4-45e1-9407-1764133852ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "d2be3178-85b4-4012-a7d0-2d8543a65a42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "e442604c-86f4-45e1-9407-1764133852ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a569c652-6b15-4244-b011-1d09fbdd4281" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:26:19 user nova-compute[71482]: INFO nova.compute.claims [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Claim successful on node user
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.network.neutron [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:26:19 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:26:19 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Creating image(s)
Apr 12 09:26:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "/opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "/opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "/opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:19 user nova-compute[71482]: DEBUG nova.policy [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e432c3374fe34540b47999d4cc361e0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f752416df0d043a4b82b204a780f597c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk 1073741824" returned: 0 in 0.050s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.152s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Checking if we can resize image /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Cannot resize image /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG nova.objects.instance [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lazy-loading 'migration_context' on Instance uuid 767f53f6-4a39-4ba7-ba02-105344e5c6fc {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Ensure instance console log exists: /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:20 user nova-compute[71482]: DEBUG nova.network.neutron [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Successfully created port: 69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Successfully updated port: 69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "refresh_cache-767f53f6-4a39-4ba7-ba02-105344e5c6fc" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquired lock "refresh_cache-767f53f6-4a39-4ba7-ba02-105344e5c6fc" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received event network-changed-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Refreshing instance network info cache due to event network-changed-69806c5e-19dc-4012-b62c-133ad94c3800. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] Acquiring lock "refresh_cache-767f53f6-4a39-4ba7-ba02-105344e5c6fc" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Updating instance_info_cache with network_info: [{"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Releasing lock "refresh_cache-767f53f6-4a39-4ba7-ba02-105344e5c6fc" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Instance network_info: |[{"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] Acquired lock "refresh_cache-767f53f6-4a39-4ba7-ba02-105344e5c6fc" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.network.neutron [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Refreshing network info cache for port 69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Start _get_guest_xml network_info=[{"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:26:21 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:26:21 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1709160961',display_name='tempest-VolumesActionsTest-instance-1709160961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1709160961',id=31,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f752416df0d043a4b82b204a780f597c',ramdisk_id='',reservation_id='r-7bv5bsur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-902475152',owner_user_name='tempest-VolumesActionsTest-902475152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:26:20Z,user_data=None,user_id='e432c3374fe34540b47999d4cc361e0e',uuid=767f53f6-4a39-4ba7-ba02-105344e5c6fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converting VIF {"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=69806c5e-19dc-4012-b62c-133ad94c3800,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69806c5e-19') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:26:21 user nova-compute[71482]: DEBUG nova.objects.instance [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lazy-loading 'pci_devices' on Instance uuid 767f53f6-4a39-4ba7-ba02-105344e5c6fc {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:26:22 user nova-compute[71482]:   <uuid>767f53f6-4a39-4ba7-ba02-105344e5c6fc</uuid>
Apr 12 09:26:22 user nova-compute[71482]:   <name>instance-0000001f</name>
Apr 12 09:26:22 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:26:22 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:26:22 user nova-compute[71482]:   <metadata>
Apr 12 09:26:22 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:26:22 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:26:22 user nova-compute[71482]:       <nova:name>tempest-VolumesActionsTest-instance-1709160961</nova:name>
Apr 12 09:26:22 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:26:21</nova:creationTime>
Apr 12 09:26:22 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:26:22 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:26:22 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:26:22 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:26:22 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:26:22 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:26:22 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:26:22 user nova-compute[71482]:       <nova:owner>
Apr 12 09:26:22 user nova-compute[71482]:         <nova:user uuid="e432c3374fe34540b47999d4cc361e0e">tempest-VolumesActionsTest-902475152-project-member</nova:user>
Apr 12 09:26:22 user nova-compute[71482]:         <nova:project uuid="f752416df0d043a4b82b204a780f597c">tempest-VolumesActionsTest-902475152</nova:project>
Apr 12 09:26:22 user nova-compute[71482]:       </nova:owner>
Apr 12 09:26:22 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:26:22 user nova-compute[71482]:       <nova:ports>
Apr 12 09:26:22 user nova-compute[71482]:         <nova:port uuid="69806c5e-19dc-4012-b62c-133ad94c3800">
Apr 12 09:26:22 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 09:26:22 user nova-compute[71482]:         </nova:port>
Apr 12 09:26:22 user nova-compute[71482]:       </nova:ports>
Apr 12 09:26:22 user nova-compute[71482]:     </nova:instance>
Apr 12 09:26:22 user nova-compute[71482]:   </metadata>
Apr 12 09:26:22 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:26:22 user nova-compute[71482]:     <system>
Apr 12 09:26:22 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:26:22 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:26:22 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:26:22 user nova-compute[71482]:       <entry name="serial">767f53f6-4a39-4ba7-ba02-105344e5c6fc</entry>
Apr 12 09:26:22 user nova-compute[71482]:       <entry name="uuid">767f53f6-4a39-4ba7-ba02-105344e5c6fc</entry>
Apr 12 09:26:22 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:26:22 user nova-compute[71482]:     </system>
Apr 12 09:26:22 user nova-compute[71482]:   </sysinfo>
Apr 12 09:26:22 user nova-compute[71482]:   <os>
Apr 12 09:26:22 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:26:22 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:26:22 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:26:22 user nova-compute[71482]:   </os>
Apr 12 09:26:22 user nova-compute[71482]:   <features>
Apr 12 09:26:22 user nova-compute[71482]:     <acpi/>
Apr 12 09:26:22 user nova-compute[71482]:     <apic/>
Apr 12 09:26:22 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:26:22 user nova-compute[71482]:   </features>
Apr 12 09:26:22 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:26:22 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:26:22 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:26:22 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:26:22 user nova-compute[71482]:   </clock>
Apr 12 09:26:22 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:26:22 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:26:22 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:26:22 user nova-compute[71482]:   </cpu>
Apr 12 09:26:22 user nova-compute[71482]:   <devices>
Apr 12 09:26:22 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:26:22 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:26:22 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk"/>
Apr 12 09:26:22 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:26:22 user nova-compute[71482]:     </disk>
Apr 12 09:26:22 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:26:22 user nova-compute[71482]:       <mac address="fa:16:3e:11:7d:51"/>
Apr 12 09:26:22 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:26:22 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:26:22 user nova-compute[71482]:       <target dev="tap69806c5e-19"/>
Apr 12 09:26:22 user nova-compute[71482]:     </interface>
Apr 12 09:26:22 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:26:22 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/console.log" append="off"/>
Apr 12 09:26:22 user nova-compute[71482]:     </serial>
Apr 12 09:26:22 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:26:22 user nova-compute[71482]:     <video>
Apr 12 09:26:22 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:26:22 user nova-compute[71482]:     </video>
Apr 12 09:26:22 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:26:22 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:26:22 user nova-compute[71482]:     </rng>
Apr 12 09:26:22 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:26:22 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:26:22 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:26:22 user nova-compute[71482]:     </memballoon>
Apr 12 09:26:22 user nova-compute[71482]:   </devices>
Apr 12 09:26:22 user nova-compute[71482]: </domain>
Apr 12 09:26:22 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1709160961',display_name='tempest-VolumesActionsTest-instance-1709160961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1709160961',id=31,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f752416df0d043a4b82b204a780f597c',ramdisk_id='',reservation_id='r-7bv5bsur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-902475152',owner_user_name='tempest-VolumesActionsTest-902475152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:26:20Z,user_data=None,user_id='e432c3374fe34540b47999d4cc361e0e',uuid=767f53f6-4a39-4ba7-ba02-105344e5c6fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converting VIF {"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=69806c5e-19dc-4012-b62c-133ad94c3800,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69806c5e-19') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG os_vif [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=69806c5e-19dc-4012-b62c-133ad94c3800,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69806c5e-19') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69806c5e-19, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69806c5e-19, col_values=(('external_ids', {'iface-id': '69806c5e-19dc-4012-b62c-133ad94c3800', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:7d:51', 'vm-uuid': '767f53f6-4a39-4ba7-ba02-105344e5c6fc'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:22 user nova-compute[71482]: INFO os_vif [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=69806c5e-19dc-4012-b62c-133ad94c3800,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69806c5e-19')
Apr 12 09:26:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] No VIF found with MAC fa:16:3e:11:7d:51, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Updated VIF entry in instance network info cache for port 69806c5e-19dc-4012-b62c-133ad94c3800. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Updating instance_info_cache with network_info: [{"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-513234ca-e1b9-499c-a000-04e42c474c25 req-76ead652-66b1-46b9-9038-14a4be407668 service nova] Releasing lock "refresh_cache-767f53f6-4a39-4ba7-ba02-105344e5c6fc" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:26:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:23 user nova-compute[71482]: DEBUG nova.compute.manager [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received event network-vif-plugged-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] Acquiring lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:23 user nova-compute[71482]: DEBUG nova.compute.manager [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] No waiting events found dispatching network-vif-plugged-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:26:23 user nova-compute[71482]: WARNING nova.compute.manager [req-b2130f55-a8fe-4fe9-8f3f-f137160236ce req-f4525e2c-9c60-4b6d-b780-ce4d05df9eb7 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received unexpected event network-vif-plugged-69806c5e-19dc-4012-b62c-133ad94c3800 for instance with vm_state building and task_state spawning.
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.compute.manager [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received event network-vif-plugged-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] Acquiring lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.compute.manager [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] No waiting events found dispatching network-vif-plugged-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:26:25 user nova-compute[71482]: WARNING nova.compute.manager [req-964db870-c9cd-4d5a-b37f-95408b777a32 req-dbea4fda-f9dc-4af6-8748-1102b2ba02a1 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received unexpected event network-vif-plugged-69806c5e-19dc-4012-b62c-133ad94c3800 for instance with vm_state building and task_state spawning.
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291585.7563329, 767f53f6-4a39-4ba7-ba02-105344e5c6fc => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:26:25 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] VM Resumed (Lifecycle Event)
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:26:25 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Instance spawned successfully.
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:26:25 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291585.7594016, 767f53f6-4a39-4ba7-ba02-105344e5c6fc => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:26:25 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] VM Started (Lifecycle Event)
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:26:25 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:26:25 user nova-compute[71482]: INFO nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Took 5.98 seconds to spawn the instance on the hypervisor.
Apr 12 09:26:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:26:26 user nova-compute[71482]: INFO nova.compute.manager [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Took 6.74 seconds to build instance.
Apr 12 09:26:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-24b737b0-f2e8-4cd7-a507-29be113ba1c1 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.842s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "e442604c-86f4-45e1-9407-1764133852ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e442604c-86f4-45e1-9407-1764133852ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "e442604c-86f4-45e1-9407-1764133852ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:31 user nova-compute[71482]: INFO nova.compute.manager [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Terminating instance
Apr 12 09:26:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG nova.compute.manager [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received event network-vif-unplugged-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] Acquiring lock "e442604c-86f4-45e1-9407-1764133852ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG nova.compute.manager [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] No waiting events found dispatching network-vif-unplugged-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG nova.compute.manager [req-58af0ced-62ae-45f9-a9bf-85594062e131 req-268238e8-7308-4424-a1c1-06736c1bbf24 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received event network-vif-unplugged-c456f016-a187-4f16-9a25-2ae020e10413 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:26:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: e442604c-86f4-45e1-9407-1764133852ef] Instance destroyed successfully.
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.objects.instance [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'resources' on Instance uuid e442604c-86f4-45e1-9407-1764133852ef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:17:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-206066750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-206066750',id=18,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:17:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-app6s433',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:19:07Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=e442604c-86f4-45e1-9407-1764133852ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "c456f016-a187-4f16-9a25-2ae020e10413", "address": "fa:16:3e:29:21:2f", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc456f016-a1", "ovs_interfaceid": "c456f016-a187-4f16-9a25-2ae020e10413", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=c456f016-a187-4f16-9a25-2ae020e10413,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc456f016-a1') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG os_vif [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=c456f016-a187-4f16-9a25-2ae020e10413,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc456f016-a1') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc456f016-a1, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:26:32 user nova-compute[71482]: INFO os_vif [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:21:2f,bridge_name='br-int',has_traffic_filtering=True,id=c456f016-a187-4f16-9a25-2ae020e10413,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc456f016-a1')
Apr 12 09:26:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Deleting instance files /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef_del
Apr 12 09:26:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Deletion of /opt/stack/data/nova/instances/e442604c-86f4-45e1-9407-1764133852ef_del complete
Apr 12 09:26:32 user nova-compute[71482]: INFO nova.compute.manager [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e442604c-86f4-45e1-9407-1764133852ef] Took 0.74 seconds to destroy the instance on the hypervisor.
Apr 12 09:26:32 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: e442604c-86f4-45e1-9407-1764133852ef] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: e442604c-86f4-45e1-9407-1764133852ef] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: e442604c-86f4-45e1-9407-1764133852ef] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:32 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: e442604c-86f4-45e1-9407-1764133852ef] Took 0.44 seconds to deallocate network for instance.
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-b7be2ee9-4e50-4a8b-925a-7399da022ede req-f9250d85-996c-415b-8af2-d4498befbc45 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received event network-vif-deleted-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:26:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:33 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Deleted allocations for instance e442604c-86f4-45e1-9407-1764133852ef
Apr 12 09:26:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44ad23c2-e7ab-4db7-96f5-4b0e03796af3 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e442604c-86f4-45e1-9407-1764133852ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.620s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received event network-vif-plugged-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] Acquiring lock "e442604c-86f4-45e1-9407-1764133852ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] Lock "e442604c-86f4-45e1-9407-1764133852ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] No waiting events found dispatching network-vif-plugged-c456f016-a187-4f16-9a25-2ae020e10413 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:26:33 user nova-compute[71482]: WARNING nova.compute.manager [req-f39ebe0f-28e7-411a-a9b5-11ecae6bcf3a req-8377dd23-dec5-4032-bfa2-fc2557c00f46 service nova] [instance: e442604c-86f4-45e1-9407-1764133852ef] Received unexpected event network-vif-plugged-c456f016-a187-4f16-9a25-2ae020e10413 for instance with vm_state deleted and task_state None.
Apr 12 09:26:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-changed-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Refreshing instance network info cache due to event network-changed-2c0316e9-6065-4c8c-8e7d-8d02f54d0083. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:26:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] Acquiring lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:26:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] Acquired lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:26:37 user nova-compute[71482]: DEBUG nova.network.neutron [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Refreshing network info cache for port 2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:26:38 user nova-compute[71482]: DEBUG nova.network.neutron [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updated VIF entry in instance network info cache for port 2c0316e9-6065-4c8c-8e7d-8d02f54d0083. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:26:38 user nova-compute[71482]: DEBUG nova.network.neutron [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updating instance_info_cache with network_info: [{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9f248167-b3de-44c7-8deb-7a6d99aef878 req-8efacb57-290e-49d4-9df9-ee5ed32b304a service nova] Releasing lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:26:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:39 user nova-compute[71482]: INFO nova.compute.manager [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Shelving
Apr 12 09:26:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-unplugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] No waiting events found dispatching network-vif-unplugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:26:40 user nova-compute[71482]: WARNING nova.compute.manager [req-ca2e5870-7fd2-4a88-a522-81bd6f644709 req-52d72e7c-b35f-4e39-a5e3-14c840203fc5 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received unexpected event network-vif-unplugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance with vm_state active and task_state shelving.
Apr 12 09:26:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance destroyed successfully.
Apr 12 09:26:40 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Beginning cold snapshot process
Apr 12 09:26:40 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:26:40 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk /opt/stack/data/nova/instances/snapshots/tmp_kdecvfd/9ec876b3ae8c4b54bd9216c2bfe3ee9d {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk /opt/stack/data/nova/instances/snapshots/tmp_kdecvfd/9ec876b3ae8c4b54bd9216c2bfe3ee9d" returned: 0 in 0.267s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Snapshot extracted, beginning image upload
Apr 12 09:26:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] No waiting events found dispatching network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:26:42 user nova-compute[71482]: WARNING nova.compute.manager [req-39da7590-3910-45cd-b7cd-1baad8ebce1b req-c976a76b-8090-4cef-ac03-02ab6fa12dff service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received unexpected event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance with vm_state active and task_state shelving_image_uploading.
Apr 12 09:26:43 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Snapshot image upload complete
Apr 12 09:26:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:26:43 user nova-compute[71482]: INFO nova.compute.manager [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Shelve offloading
Apr 12 09:26:43 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance destroyed successfully.
Apr 12 09:26:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:26:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:26:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquired lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:26:43 user nova-compute[71482]: DEBUG nova.network.neutron [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:26:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:43 user nova-compute[71482]: DEBUG nova.network.neutron [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updating instance_info_cache with network_info: [{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Releasing lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:26:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance destroyed successfully.
Apr 12 09:26:44 user nova-compute[71482]: DEBUG nova.objects.instance [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'resources' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368249722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368249722',id=29,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5L2YPZ2KVlhG6oFOZGGwTxHh7VmuiAaOSH0We/vpq8fOiO1mNYzg6+tMndipazXRpul18uCeRgGch/My5l++MyiqK2qEK0kNajHsUhulUGdS/XiM9WXRLjaM3kVzoxA==',key_name='tempest-keypair-202654117',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:24:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-i7mje20m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member',shelved_at='2023-04-12T09:26:43.377665',shelved_host='user',shelved_image_id='a385a44d-4df5-4e6e-a6cb-8f03ffa1b3f4'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:26:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=8a52d45c-9ce4-4e4f-973a-fffce9f85bef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG os_vif [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c0316e9-60, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-changed-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Refreshing instance network info cache due to event network-changed-2c0316e9-6065-4c8c-8e7d-8d02f54d0083. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] Acquiring lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] Acquired lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.network.neutron [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Refreshing network info cache for port 2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:26:45 user nova-compute[71482]: INFO os_vif [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60')
Apr 12 09:26:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Deleting instance files /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef_del
Apr 12 09:26:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Deletion of /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef_del complete
Apr 12 09:26:45 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Deleted allocations for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef
Apr 12 09:26:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.objects.instance [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25651af7-942b-4e34-af48-f52b3878ff3f tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.639s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.network.neutron [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updated VIF entry in instance network info cache for port 2c0316e9-6065-4c8c-8e7d-8d02f54d0083. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG nova.network.neutron [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updating instance_info_cache with network_info: [{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2c0316e9-60", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-862ccb6d-0b9a-4f69-ab06-c88834a79f9d req-3ab61517-9468-4cbb-bb01-a7527ca1f499 service nova] Releasing lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:26:47 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291592.0935743, e442604c-86f4-45e1-9407-1764133852ef => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:26:47 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: e442604c-86f4-45e1-9407-1764133852ef] VM Stopped (Lifecycle Event)
Apr 12 09:26:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-862ee1ca-f89b-43ac-85e8-66b4e719c356 None None] [instance: e442604c-86f4-45e1-9407-1764133852ef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:26:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:50 user nova-compute[71482]: INFO nova.compute.manager [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Terminating instance
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received event network-vif-unplugged-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] No waiting events found dispatching network-vif-unplugged-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-b2e3d982-774f-4c37-a854-d1ad446e8b46 req-19b5603e-aa24-4ebb-83ec-1e4a85b09079 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received event network-vif-unplugged-1f40ed54-078b-4028-95a6-6b5788a57cad for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:50 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Instance destroyed successfully.
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.objects.instance [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'resources' on Instance uuid d64edc05-fbf3-4f89-908f-ca221919c596 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:23:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-570926451',display_name='tempest-AttachVolumeNegativeTest-server-570926451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-570926451',id=28,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQvNBBITxsZM9HuPSiY+QeZXsqErxagnjcOfJSEEh8Hxht3gNkT9m9qDL9dit5iq1Z2fJAWET+og+pU/DVCG+EfQBdzSQWdTogdyqzLzRAYHWUbY3WYrPn4HTz5OdXtDQ==',key_name='tempest-keypair-1087718719',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-wnapsgil',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:24:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=d64edc05-fbf3-4f89-908f-ca221919c596,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "1f40ed54-078b-4028-95a6-6b5788a57cad", "address": "fa:16:3e:e5:57:bd", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f40ed54-07", "ovs_interfaceid": "1f40ed54-078b-4028-95a6-6b5788a57cad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:57:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f40ed54-078b-4028-95a6-6b5788a57cad,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f40ed54-07') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG os_vif [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:57:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f40ed54-078b-4028-95a6-6b5788a57cad,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f40ed54-07') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f40ed54-07, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:26:50 user nova-compute[71482]: INFO os_vif [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:57:bd,bridge_name='br-int',has_traffic_filtering=True,id=1f40ed54-078b-4028-95a6-6b5788a57cad,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f40ed54-07')
Apr 12 09:26:50 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Deleting instance files /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596_del
Apr 12 09:26:50 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Deletion of /opt/stack/data/nova/instances/d64edc05-fbf3-4f89-908f-ca221919c596_del complete
Apr 12 09:26:50 user nova-compute[71482]: INFO nova.compute.manager [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Took 0.84 seconds to destroy the instance on the hypervisor.
Apr 12 09:26:50 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:26:50 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:26:51 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:51 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Took 0.99 seconds to deallocate network for instance.
Apr 12 09:26:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received event network-vif-deleted-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:51 user nova-compute[71482]: INFO nova.compute.manager [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Neutron deleted interface 1f40ed54-078b-4028-95a6-6b5788a57cad; detaching it from the instance and deleting it from the info cache
Apr 12 09:26:51 user nova-compute[71482]: DEBUG nova.network.neutron [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-498e239a-b2e9-4b97-b48d-062dd61e256c req-d292b7c8-0da3-43b1-98cd-5fa42561ce48 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Detach interface failed, port_id=1f40ed54-078b-4028-95a6-6b5788a57cad, reason: Instance d64edc05-fbf3-4f89-908f-ca221919c596 could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:52 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Deleted allocations for instance d64edc05-fbf3-4f89-908f-ca221919c596
Apr 12 09:26:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received event network-vif-plugged-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] Acquiring lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] Lock "d64edc05-fbf3-4f89-908f-ca221919c596-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] No waiting events found dispatching network-vif-plugged-1f40ed54-078b-4028-95a6-6b5788a57cad {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:26:52 user nova-compute[71482]: WARNING nova.compute.manager [req-f32a0d6c-29bb-45d2-ab33-aebd159bc5fc req-fb6ddfe9-d4de-4f0b-b754-5719499de1e0 service nova] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Received unexpected event network-vif-plugged-1f40ed54-078b-4028-95a6-6b5788a57cad for instance with vm_state deleted and task_state None.
Apr 12 09:26:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-bd9d1571-2ff7-4dcd-a70a-f48af85ff03b tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d64edc05-fbf3-4f89-908f-ca221919c596" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:53 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:54 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:54 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:26:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:54 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:26:54 user nova-compute[71482]: INFO nova.compute.claims [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Claim successful on node user
Apr 12 09:26:54 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:26:54 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:26:55 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.policy [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:26:55 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Creating image(s)
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "/opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "/opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "/opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk 1073741824" returned: 0 in 0.046s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291600.652669, 8a52d45c-9ce4-4e4f-973a-fffce9f85bef => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:26:55 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] VM Stopped (Lifecycle Event)
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.compute.manager [None req-16394ce6-2daf-4878-8c91-aff01e5ff0be None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Cannot resize image /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lazy-loading 'migration_context' on Instance uuid 16ed5717-a2c5-469a-b1c8-2577b4debc2f {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Ensure instance console log exists: /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:55 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Successfully created port: 267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Successfully updated port: 267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquired lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG nova.compute.manager [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received event network-changed-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG nova.compute.manager [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Refreshing instance network info cache due to event network-changed-267e3243-9c0f-454c-a691-ee2d1f4fcddf. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] Acquiring lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:26:56 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updating instance_info_cache with network_info: [{"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Releasing lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Instance network_info: |[{"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] Acquired lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.network.neutron [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Refreshing network info cache for port 267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Start _get_guest_xml network_info=[{"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:26:57 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:26:57 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-323240227',display_name='tempest-ServersNegativeTestJSON-server-323240227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-323240227',id=32,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcea1b997ee6450dbf603305d2812f7f',ramdisk_id='',reservation_id='r-od9d16uw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1848567648',owner_user_name='tempest-ServersNegativeTestJSON-1848567648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:26:55Z,user_data=None,user_id='741e227a2cc7425d8b171c2a04989191',uuid=16ed5717-a2c5-469a-b1c8-2577b4debc2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converting VIF {"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:54:2f,bridge_name='br-int',has_traffic_filtering=True,id=267e3243-9c0f-454c-a691-ee2d1f4fcddf,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267e3243-9c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lazy-loading 'pci_devices' on Instance uuid 16ed5717-a2c5-469a-b1c8-2577b4debc2f {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:26:57 user nova-compute[71482]:   <uuid>16ed5717-a2c5-469a-b1c8-2577b4debc2f</uuid>
Apr 12 09:26:57 user nova-compute[71482]:   <name>instance-00000020</name>
Apr 12 09:26:57 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:26:57 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:26:57 user nova-compute[71482]:   <metadata>
Apr 12 09:26:57 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:26:57 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:26:57 user nova-compute[71482]:       <nova:name>tempest-ServersNegativeTestJSON-server-323240227</nova:name>
Apr 12 09:26:57 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:26:57</nova:creationTime>
Apr 12 09:26:57 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:26:57 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:26:57 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:26:57 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:26:57 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:26:57 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:26:57 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:26:57 user nova-compute[71482]:       <nova:owner>
Apr 12 09:26:57 user nova-compute[71482]:         <nova:user uuid="741e227a2cc7425d8b171c2a04989191">tempest-ServersNegativeTestJSON-1848567648-project-member</nova:user>
Apr 12 09:26:57 user nova-compute[71482]:         <nova:project uuid="dcea1b997ee6450dbf603305d2812f7f">tempest-ServersNegativeTestJSON-1848567648</nova:project>
Apr 12 09:26:57 user nova-compute[71482]:       </nova:owner>
Apr 12 09:26:57 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:26:57 user nova-compute[71482]:       <nova:ports>
Apr 12 09:26:57 user nova-compute[71482]:         <nova:port uuid="267e3243-9c0f-454c-a691-ee2d1f4fcddf">
Apr 12 09:26:57 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 09:26:57 user nova-compute[71482]:         </nova:port>
Apr 12 09:26:57 user nova-compute[71482]:       </nova:ports>
Apr 12 09:26:57 user nova-compute[71482]:     </nova:instance>
Apr 12 09:26:57 user nova-compute[71482]:   </metadata>
Apr 12 09:26:57 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:26:57 user nova-compute[71482]:     <system>
Apr 12 09:26:57 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:26:57 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:26:57 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:26:57 user nova-compute[71482]:       <entry name="serial">16ed5717-a2c5-469a-b1c8-2577b4debc2f</entry>
Apr 12 09:26:57 user nova-compute[71482]:       <entry name="uuid">16ed5717-a2c5-469a-b1c8-2577b4debc2f</entry>
Apr 12 09:26:57 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:26:57 user nova-compute[71482]:     </system>
Apr 12 09:26:57 user nova-compute[71482]:   </sysinfo>
Apr 12 09:26:57 user nova-compute[71482]:   <os>
Apr 12 09:26:57 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:26:57 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:26:57 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:26:57 user nova-compute[71482]:   </os>
Apr 12 09:26:57 user nova-compute[71482]:   <features>
Apr 12 09:26:57 user nova-compute[71482]:     <acpi/>
Apr 12 09:26:57 user nova-compute[71482]:     <apic/>
Apr 12 09:26:57 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:26:57 user nova-compute[71482]:   </features>
Apr 12 09:26:57 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:26:57 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:26:57 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:26:57 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:26:57 user nova-compute[71482]:   </clock>
Apr 12 09:26:57 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:26:57 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:26:57 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:26:57 user nova-compute[71482]:   </cpu>
Apr 12 09:26:57 user nova-compute[71482]:   <devices>
Apr 12 09:26:57 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:26:57 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:26:57 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk"/>
Apr 12 09:26:57 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:26:57 user nova-compute[71482]:     </disk>
Apr 12 09:26:57 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:26:57 user nova-compute[71482]:       <mac address="fa:16:3e:a4:54:2f"/>
Apr 12 09:26:57 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:26:57 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:26:57 user nova-compute[71482]:       <target dev="tap267e3243-9c"/>
Apr 12 09:26:57 user nova-compute[71482]:     </interface>
Apr 12 09:26:57 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:26:57 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/console.log" append="off"/>
Apr 12 09:26:57 user nova-compute[71482]:     </serial>
Apr 12 09:26:57 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:26:57 user nova-compute[71482]:     <video>
Apr 12 09:26:57 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:26:57 user nova-compute[71482]:     </video>
Apr 12 09:26:57 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:26:57 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:26:57 user nova-compute[71482]:     </rng>
Apr 12 09:26:57 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:26:57 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:26:57 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:26:57 user nova-compute[71482]:     </memballoon>
Apr 12 09:26:57 user nova-compute[71482]:   </devices>
Apr 12 09:26:57 user nova-compute[71482]: </domain>
Apr 12 09:26:57 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-323240227',display_name='tempest-ServersNegativeTestJSON-server-323240227',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-323240227',id=32,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcea1b997ee6450dbf603305d2812f7f',ramdisk_id='',reservation_id='r-od9d16uw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1848567648',owner_user_name='tempest-ServersNegativeTestJSON-1848567648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:26:55Z,user_data=None,user_id='741e227a2cc7425d8b171c2a04989191',uuid=16ed5717-a2c5-469a-b1c8-2577b4debc2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converting VIF {"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:54:2f,bridge_name='br-int',has_traffic_filtering=True,id=267e3243-9c0f-454c-a691-ee2d1f4fcddf,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267e3243-9c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG os_vif [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:54:2f,bridge_name='br-int',has_traffic_filtering=True,id=267e3243-9c0f-454c-a691-ee2d1f4fcddf,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267e3243-9c') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap267e3243-9c, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap267e3243-9c, col_values=(('external_ids', {'iface-id': '267e3243-9c0f-454c-a691-ee2d1f4fcddf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:54:2f', 'vm-uuid': '16ed5717-a2c5-469a-b1c8-2577b4debc2f'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:57 user nova-compute[71482]: INFO os_vif [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:54:2f,bridge_name='br-int',has_traffic_filtering=True,id=267e3243-9c0f-454c-a691-ee2d1f4fcddf,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267e3243-9c')
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] No VIF found with MAC fa:16:3e:a4:54:2f, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.network.neutron [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updated VIF entry in instance network info cache for port 267e3243-9c0f-454c-a691-ee2d1f4fcddf. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG nova.network.neutron [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updating instance_info_cache with network_info: [{"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:26:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e830de43-983c-48ca-8686-66dda8c96da9 req-ceb9214c-fd84-40ca-89df-ecca78d75fb3 service nova] Releasing lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG nova.compute.manager [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received event network-vif-plugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] Acquiring lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:26:58 user nova-compute[71482]: DEBUG nova.compute.manager [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] No waiting events found dispatching network-vif-plugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:26:58 user nova-compute[71482]: WARNING nova.compute.manager [req-54c48fc3-64f3-401f-9f66-d751f81c634a req-185645c1-a5b5-42c4-aaf0-5ef9b9113e1d service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received unexpected event network-vif-plugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance with vm_state building and task_state spawning.
Apr 12 09:26:59 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:26:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:26:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291620.7972305, 16ed5717-a2c5-469a-b1c8-2577b4debc2f => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:27:00 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] VM Resumed (Lifecycle Event)
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:27:00 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Instance spawned successfully.
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:00 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291620.7988098, 16ed5717-a2c5-469a-b1c8-2577b4debc2f => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:27:00 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] VM Started (Lifecycle Event)
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:27:00 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:27:00 user nova-compute[71482]: INFO nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Took 5.67 seconds to spawn the instance on the hypervisor.
Apr 12 09:27:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:01 user nova-compute[71482]: INFO nova.compute.manager [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Took 6.30 seconds to build instance.
Apr 12 09:27:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2f2768b7-e525-4e47-8100-4f5d6b96383e tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.393s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received event network-vif-plugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] Acquiring lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] No waiting events found dispatching network-vif-plugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:27:01 user nova-compute[71482]: WARNING nova.compute.manager [req-269fa077-0d26-485f-999a-03ee8066e48d req-1a2827b0-008b-471e-9b4a-dda2d39270b3 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received unexpected event network-vif-plugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance with vm_state active and task_state None.
Apr 12 09:27:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Stashing vm_state: active {{(pid=71482) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 12 09:27:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'pci_requests' on Instance uuid 6720b589-6dc8-460a-bdc2-52b9b1cd77fb {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:27:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:27:02 user nova-compute[71482]: INFO nova.compute.claims [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Claim successful on node user
Apr 12 09:27:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'resources' on Instance uuid 6720b589-6dc8-460a-bdc2-52b9b1cd77fb {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:27:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'pci_devices' on Instance uuid 6720b589-6dc8-460a-bdc2-52b9b1cd77fb {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:27:02 user nova-compute[71482]: INFO nova.compute.resource_tracker [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating resource usage from migration aeb9c6a7-edb3-40f0-9f4e-d0c076fc22ff
Apr 12 09:27:02 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:27:02 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:27:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.356s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:02 user nova-compute[71482]: INFO nova.compute.manager [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Migrating
Apr 12 09:27:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:27:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:27:03 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:27:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received event network-changed-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Refreshing instance network info cache due to event network-changed-0ea8781f-860c-4135-8264-ad52a792fa55. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:27:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Acquiring lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:27:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Acquired lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:27:03 user nova-compute[71482]: DEBUG nova.network.neutron [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Refreshing network info cache for port 0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:27:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating instance_info_cache with network_info: [{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG nova.network.neutron [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updated VIF entry in instance network info cache for port 0ea8781f-860c-4135-8264-ad52a792fa55. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG nova.network.neutron [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updating instance_info_cache with network_info: [{"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Releasing lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-changed-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Refreshing instance network info cache due to event network-changed-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Acquiring lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Acquired lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG nova.network.neutron [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Refreshing network info cache for port d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Starting migrate_disk_and_power_off {{(pid=71482) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-unplugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] No waiting events found dispatching network-vif-unplugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:27:04 user nova-compute[71482]: WARNING nova.compute.manager [req-70cfa8ad-cea8-482d-a4a6-d043c0348f31 req-5ecb3f74-2a0d-4e03-bf64-ed76b5b98b83 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received unexpected event network-vif-unplugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance with vm_state active and task_state resize_migrating.
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.network.neutron [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updated VIF entry in instance network info cache for port d6dffcd5-fc3c-47e6-a72e-22d72ab3a406. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.network.neutron [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating instance_info_cache with network_info: [{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb786d4c-7c9e-4fe8-948c-998bec8d4d5c req-61503420-a518-40fc-bf09-bd083f6b6583 service nova] Releasing lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:27:05 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Instance destroyed successfully.
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-310903129',display_name='tempest-ServerActionsTestJSON-server-310903129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-310903129',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-0yzal2xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:27:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=6720b589-6dc8-460a-bdc2-52b9b1cd77fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:b5:91:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:b5:91:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_vif [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6dffcd5-fc, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:27:05 user nova-compute[71482]: INFO os_vif [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc')
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmQZiMUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:27:05 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc3d0c5-53f1-4f12-abd3-ba3587f5681b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:27:05 user nova-compute[71482]: No targets found.
Apr 12 09:27:05 user nova-compute[71482]: iSNS:
Apr 12 09:27:05 user nova-compute[71482]: No targets found.
Apr 12 09:27:05 user nova-compute[71482]: STATIC:
Apr 12 09:27:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2
Apr 12 09:27:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:27:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:27:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:27:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:27:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:27:05 user nova-compute[71482]: FIRMWARE:
Apr 12 09:27:05 user nova-compute[71482]: No targets found.
Apr 12 09:27:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:27:05 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:27:05 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb857a47-d890-4327-93a7-d9e7ed1a8b2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9644004-9a63-4920-ae29-bc13e0a5e033]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:27:05 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:27:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:27:05 user nova-compute[71482]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:27:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9349cc3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bffc3f-b0d6-4203-9091-4d2d7ec01a6e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e67e965-746c-4570-94e4-9f96fb183fb0]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d0af78-9eae-4b81-8981-f5bc8982a668]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2578f2-47e6-4e47-90fe-ae743f561d51]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_43120c23', '/dev/disk/by-id/scsi-23762343237323836', '/dev/disk/by-id/scsi-1SCST_BIO43120c23-7b427286155889cf') {{(pid=82392) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6a4968-0f6f-4a66-bbe4-68eda7045d41]: (4, None) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0b3a9a-f8b3-4892-827f-c721b73c26b4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[326d684f-f0b0-44bf-9a34-35a60a040739]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260]
Apr 12 09:27:05 user nova-compute[71482]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260] successful.
Apr 12 09:27:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c169f0-cd1a-4084-9082-5da9b74236a8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== disconnect_volume: return (326ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291610.8432143, d64edc05-fbf3-4f89-908f-ca221919c596 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:27:05 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] VM Stopped (Lifecycle Event)
Apr 12 09:27:05 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a85bad01-fa2a-4f9a-a48a-a79ce09622c8 None None] [instance: d64edc05-fbf3-4f89-908f-ca221919c596] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Port d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 binding to destination host user is already ACTIVE {{(pid=71482) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] No waiting events found dispatching network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:27:06 user nova-compute[71482]: WARNING nova.compute.manager [req-edf34702-77a5-4048-a3dc-66eee9d9ab16 req-ac01c2b1-2887-4114-afca-9a0fc45fe743 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received unexpected event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance with vm_state active and task_state resize_migrated.
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating instance_info_cache with network_info: [{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG os_brick.utils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93427c9-308c-4323-98f9-0a9326a43794]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6801bd6c-88ac-49a7-bee9-a9fb130b2541]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b5c8b9-9ba4-402e-b417-78925476b62b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6f7df2-40f3-400c-bbec-7764843982dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:27:07 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e24573d-7ba0-4b43-b272-fa90000036d5]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG os_brick.utils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:27:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8312MB free_disk=26.276336669921875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Applying migration context for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb as it has an incoming, in-progress migration aeb9c6a7-edb3-40f0-9f4e-d0c076fc22ff. Migration status is post-migrating {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 09:27:08 user nova-compute[71482]: INFO nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating resource usage from migration aeb9c6a7-edb3-40f0-9f4e-d0c076fc22ff
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance e2070294-eb8a-4ee9-a4b5-baab508d8744 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Migration aeb9c6a7-edb3-40f0-9f4e-d0c076fc22ff is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:27:08 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:27:09 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:27:09 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:27:09 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:27:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.383s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Starting finish_migration {{(pid=71482) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Instance directory exists: not creating {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 12 09:27:12 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Creating image(s)
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Ensure instance console log exists: /opt/stack/data/nova/instances/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Start _get_guest_xml network_info=[{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:b5:91:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a21d8ef8-6962-45cb-a96f-5c0d18612ef5', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmQZiMUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '6720b589-6dc8-460a-bdc2-52b9b1cd77fb', 'attached_at': '2023-04-12T09:27:12.000000', 'detached_at': '', 'volume_id': 'da73130e-1f1c-40e7-9961-d5b661f114a2', 'serial': 'da73130e-1f1c-40e7-9961-d5b661f114a2'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:27:12 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:27:12 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:15Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6720b589-6dc8-460a-bdc2-52b9b1cd77fb {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmQZiMUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:27:12 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:27:12 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:27:12 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6e7f04-39a6-4596-be72-dcf53c79e767]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:27:12 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a2a368-c9e6-4af3-8839-07789001ed0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2] added
Apr 12 09:27:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e60008b-192d-46be-818f-d9684284ed7d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6279c9c9-bb3a-4f48-9db3-74caa3918b8e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmQZiMUS {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmQZiMUS" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecba566-9b08-4a6f-b79b-6527151ef49b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CmQZiMUS'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a77fe6-107b-42fb-a366-3c561ca3ab70]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa32a7f6-cbf9-4f1a-abb0-f59cc0d64153]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:27:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:27:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[373cfef7-a319-4088-a86b-a7ff58beecd2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260]
Apr 12 09:27:12 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260] successful.
Apr 12 09:27:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[903bee2d-54bc-450c-9395-3c65231c88eb]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5094d502-f15e-42af-ab69-b25862830ed4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:27:12 user nova-compute[71482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:27:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:27:12 user nova-compute[71482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:27:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2121d145-6d43-4bad-9620-a7b01cb344b9]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:27:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmQZiMUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23762343237323836', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762343237323836', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-310903129',display_name='tempest-ServerActionsTestJSON-server-310903129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-310903129',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-0yzal2xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:27:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=6720b589-6dc8-460a-bdc2-52b9b1cd77fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:b5:91:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:b5:91:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:27:13 user nova-compute[71482]:   <uuid>6720b589-6dc8-460a-bdc2-52b9b1cd77fb</uuid>
Apr 12 09:27:13 user nova-compute[71482]:   <name>instance-0000001e</name>
Apr 12 09:27:13 user nova-compute[71482]:   <memory>196608</memory>
Apr 12 09:27:13 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:27:13 user nova-compute[71482]:   <metadata>
Apr 12 09:27:13 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:27:13 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:27:13 user nova-compute[71482]:       <nova:name>tempest-ServerActionsTestJSON-server-310903129</nova:name>
Apr 12 09:27:13 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:27:12</nova:creationTime>
Apr 12 09:27:13 user nova-compute[71482]:       <nova:flavor name="m1.micro">
Apr 12 09:27:13 user nova-compute[71482]:         <nova:memory>192</nova:memory>
Apr 12 09:27:13 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:27:13 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:27:13 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:27:13 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:27:13 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:27:13 user nova-compute[71482]:       <nova:owner>
Apr 12 09:27:13 user nova-compute[71482]:         <nova:user uuid="375db5b9a80244d3878822049230ba47">tempest-ServerActionsTestJSON-1142062861-project-member</nova:user>
Apr 12 09:27:13 user nova-compute[71482]:         <nova:project uuid="20b8c89c46bb460f9f94be9426a22bb8">tempest-ServerActionsTestJSON-1142062861</nova:project>
Apr 12 09:27:13 user nova-compute[71482]:       </nova:owner>
Apr 12 09:27:13 user nova-compute[71482]:       <nova:ports>
Apr 12 09:27:13 user nova-compute[71482]:         <nova:port uuid="d6dffcd5-fc3c-47e6-a72e-22d72ab3a406">
Apr 12 09:27:13 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:27:13 user nova-compute[71482]:         </nova:port>
Apr 12 09:27:13 user nova-compute[71482]:       </nova:ports>
Apr 12 09:27:13 user nova-compute[71482]:     </nova:instance>
Apr 12 09:27:13 user nova-compute[71482]:   </metadata>
Apr 12 09:27:13 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:27:13 user nova-compute[71482]:     <system>
Apr 12 09:27:13 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:27:13 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:27:13 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:27:13 user nova-compute[71482]:       <entry name="serial">6720b589-6dc8-460a-bdc2-52b9b1cd77fb</entry>
Apr 12 09:27:13 user nova-compute[71482]:       <entry name="uuid">6720b589-6dc8-460a-bdc2-52b9b1cd77fb</entry>
Apr 12 09:27:13 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:27:13 user nova-compute[71482]:     </system>
Apr 12 09:27:13 user nova-compute[71482]:   </sysinfo>
Apr 12 09:27:13 user nova-compute[71482]:   <os>
Apr 12 09:27:13 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:27:13 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:27:13 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:27:13 user nova-compute[71482]:   </os>
Apr 12 09:27:13 user nova-compute[71482]:   <features>
Apr 12 09:27:13 user nova-compute[71482]:     <acpi/>
Apr 12 09:27:13 user nova-compute[71482]:     <apic/>
Apr 12 09:27:13 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:27:13 user nova-compute[71482]:   </features>
Apr 12 09:27:13 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:27:13 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:27:13 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:27:13 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:27:13 user nova-compute[71482]:   </clock>
Apr 12 09:27:13 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:27:13 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:27:13 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:27:13 user nova-compute[71482]:   </cpu>
Apr 12 09:27:13 user nova-compute[71482]:   <devices>
Apr 12 09:27:13 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:27:13 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:27:13 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:27:13 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:27:13 user nova-compute[71482]:       <serial>da73130e-1f1c-40e7-9961-d5b661f114a2</serial>
Apr 12 09:27:13 user nova-compute[71482]:     </disk>
Apr 12 09:27:13 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:27:13 user nova-compute[71482]:       <mac address="fa:16:3e:b5:91:cc"/>
Apr 12 09:27:13 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:27:13 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:27:13 user nova-compute[71482]:       <target dev="tapd6dffcd5-fc"/>
Apr 12 09:27:13 user nova-compute[71482]:     </interface>
Apr 12 09:27:13 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:27:13 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/6720b589-6dc8-460a-bdc2-52b9b1cd77fb/console.log" append="off"/>
Apr 12 09:27:13 user nova-compute[71482]:     </serial>
Apr 12 09:27:13 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:27:13 user nova-compute[71482]:     <video>
Apr 12 09:27:13 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:27:13 user nova-compute[71482]:     </video>
Apr 12 09:27:13 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:27:13 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:27:13 user nova-compute[71482]:     </rng>
Apr 12 09:27:13 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:27:13 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:27:13 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:27:13 user nova-compute[71482]:     </memballoon>
Apr 12 09:27:13 user nova-compute[71482]:   </devices>
Apr 12 09:27:13 user nova-compute[71482]: </domain>
Apr 12 09:27:13 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-310903129',display_name='tempest-ServerActionsTestJSON-server-310903129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-310903129',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:25:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-0yzal2xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:27:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=6720b589-6dc8-460a-bdc2-52b9b1cd77fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:b5:91:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-706330370-network", "vif_mac": "fa:16:3e:b5:91:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG os_vif [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6dffcd5-fc, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6dffcd5-fc, col_values=(('external_ids', {'iface-id': 'd6dffcd5-fc3c-47e6-a72e-22d72ab3a406', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:91:cc', 'vm-uuid': '6720b589-6dc8-460a-bdc2-52b9b1cd77fb'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:13 user nova-compute[71482]: INFO os_vif [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc')
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] No VIF found with MAC fa:16:3e:b5:91:cc, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:27:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] No waiting events found dispatching network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:27:15 user nova-compute[71482]: WARNING nova.compute.manager [req-75e29509-24d9-4449-a252-07eeea3831a9 req-db6daf56-909a-4243-85ac-b5c5db01bb45 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received unexpected event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance with vm_state active and task_state resize_finish.
Apr 12 09:27:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 6720b589-6dc8-460a-bdc2-52b9b1cd77fb due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:27:16 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291636.9640152, 6720b589-6dc8-460a-bdc2-52b9b1cd77fb => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:27:16 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] VM Resumed (Lifecycle Event)
Apr 12 09:27:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:27:16 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Instance running successfully.
Apr 12 09:27:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Failed to set time: agent not configured {{(pid=71482) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 12 09:27:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a4155ce9-095c-45df-b9ee-e3b6b922ace7 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] finish_migration finished successfully. {{(pid=71482) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 12 09:27:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:27:17 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 09:27:17 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291636.9666731, 6720b589-6dc8-460a-bdc2-52b9b1cd77fb => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:27:17 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] VM Started (Lifecycle Event)
Apr 12 09:27:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:27:17 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 12 09:27:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] No waiting events found dispatching network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:27:17 user nova-compute[71482]: WARNING nova.compute.manager [req-b6817a09-a4ea-4acc-84d2-12bd8e8c2765 req-8e7fa383-b88a-4ab3-96b3-2a8e786f699e service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received unexpected event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance with vm_state resized and task_state None.
Apr 12 09:27:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:21 user nova-compute[71482]: INFO nova.compute.manager [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Terminating instance
Apr 12 09:27:21 user nova-compute[71482]: DEBUG nova.compute.manager [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-unplugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-unplugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-f9ddddc6-0f60-4d2e-af29-b29527329bba req-5a92c1e3-0941-4cdb-a903-d1c2c3cbabf2 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-unplugged-2c417659-5031-44dd-9796-062033960cc6 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:22 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Instance destroyed successfully.
Apr 12 09:27:22 user nova-compute[71482]: DEBUG nova.objects.instance [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'resources' on Instance uuid e2070294-eb8a-4ee9-a4b5-baab508d8744 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1955348970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1955348970',id=12,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:13:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-e5mpec81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:15:24Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=e2070294-eb8a-4ee9-a4b5-baab508d8744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "2c417659-5031-44dd-9796-062033960cc6", "address": "fa:16:3e:77:49:9c", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c417659-50", "ovs_interfaceid": "2c417659-5031-44dd-9796-062033960cc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c417659-5031-44dd-9796-062033960cc6,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c417659-50') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_vif [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c417659-5031-44dd-9796-062033960cc6,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c417659-50') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c417659-50, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:27:22 user nova-compute[71482]: INFO os_vif [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:49:9c,bridge_name='br-int',has_traffic_filtering=True,id=2c417659-5031-44dd-9796-062033960cc6,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c417659-50')
Apr 12 09:27:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvGLmXMJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:27:22 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ff1168-8b50-49a8-a202-3bc0137c0cba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:27:22 user nova-compute[71482]: No targets found.
Apr 12 09:27:22 user nova-compute[71482]: iSNS:
Apr 12 09:27:22 user nova-compute[71482]: No targets found.
Apr 12 09:27:22 user nova-compute[71482]: STATIC:
Apr 12 09:27:22 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2
Apr 12 09:27:22 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:27:22 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:27:22 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae
Apr 12 09:27:22 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:27:22 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:27:22 user nova-compute[71482]: FIRMWARE:
Apr 12 09:27:22 user nova-compute[71482]: No targets found.
Apr 12 09:27:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:27:22 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:27:22 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c4764f-4ac9-47ea-a6d1-61bcb9b2c320]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50eb305-74da-4bcf-ac37-bb796ce42c93]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:27:22 user nova-compute[71482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:27:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae (non-flash)
Apr 12 09:27:22 user nova-compute[71482]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:27:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c25e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b0a910-0892-4c8e-b6f0-05e0a16a1b5a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aabde14-6a06-4a70-91d0-9f23708fc436]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db87531-fa75-43e9-b652-f89381bbbba1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ff0bb0-eede-47c5-bb20-10c5dab3cdc9]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b98cbfb-696f-4405-af6e-5b831caac884]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[519d992a-14fb-4e98-811c-ddd7bb8edb50]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae, portal: 172.16.0.220,3260]
Apr 12 09:27:23 user nova-compute[71482]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae, portal: 172.16.0.220,3260] successful.
Apr 12 09:27:23 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4192d3db-69e0-430c-a44a-27c9d897c4ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e15657-11d1-4741-8ffa-8d1c85cb369d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] <== disconnect_volume: return (297ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:27:23 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Deleting instance files /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744_del
Apr 12 09:27:23 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Deletion of /opt/stack/data/nova/instances/e2070294-eb8a-4ee9-a4b5-baab508d8744_del complete
Apr 12 09:27:23 user nova-compute[71482]: INFO nova.compute.manager [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Took 1.14 seconds to destroy the instance on the hypervisor.
Apr 12 09:27:23 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:27:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:23 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Took 0.51 seconds to deallocate network for instance.
Apr 12 09:27:23 user nova-compute[71482]: DEBUG nova.compute.manager [req-95e717a6-e729-4aab-a06f-32bd8ee81e6f req-5be6d78e-42f0-486f-b418-c79f13dbb7d9 service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-deleted-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] Acquiring lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] No waiting events found dispatching network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:27:24 user nova-compute[71482]: WARNING nova.compute.manager [req-ad3e88e5-1531-4e04-bdce-1388198bab77 req-64d00f6e-a24b-4306-a08a-2bdad33b116f service nova] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Received unexpected event network-vif-plugged-2c417659-5031-44dd-9796-062033960cc6 for instance with vm_state active and task_state deleting.
Apr 12 09:27:24 user nova-compute[71482]: INFO nova.compute.manager [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Took 0.83 seconds to detach 1 volumes for instance.
Apr 12 09:27:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:24 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:27:24 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:27:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:24 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Deleted allocations for instance e2070294-eb8a-4ee9-a4b5-baab508d8744
Apr 12 09:27:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-332e3835-2807-468b-89d7-91e5f5ae01aa tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "e2070294-eb8a-4ee9-a4b5-baab508d8744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.029s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:37 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291642.7094297, e2070294-eb8a-4ee9-a4b5-baab508d8744 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:27:37 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] VM Stopped (Lifecycle Event)
Apr 12 09:27:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-21b2050d-4056-4702-b76b-d2c5c297579c None None] [instance: e2070294-eb8a-4ee9-a4b5-baab508d8744] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:44 user nova-compute[71482]: DEBUG nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:27:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:44 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:27:44 user nova-compute[71482]: INFO nova.compute.claims [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Claim successful on node user
Apr 12 09:27:44 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:27:44 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:27:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:44 user nova-compute[71482]: DEBUG nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.network.neutron [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:27:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.policy [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f91fed06f9547d29125f38fe2d47221', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37b4beaf457f4120bcbcd2b033d5c3db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:27:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Creating image(s)
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "/opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "/opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk 1073741824" returned: 0 in 0.047s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Cannot resize image /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.objects.instance [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'migration_context' on Instance uuid a8a87d28-e580-44f4-b257-ba4b4d7fa223 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.network.neutron [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Successfully created port: f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Ensure instance console log exists: /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Successfully updated port: f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "refresh_cache-a8a87d28-e580-44f4-b257-ba4b4d7fa223" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquired lock "refresh_cache-a8a87d28-e580-44f4-b257-ba4b4d7fa223" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-changed-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Refreshing instance network info cache due to event network-changed-f3d58c2b-2ae0-4211-8ab8-034c875fd516. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] Acquiring lock "refresh_cache-a8a87d28-e580-44f4-b257-ba4b4d7fa223" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Updating instance_info_cache with network_info: [{"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Releasing lock "refresh_cache-a8a87d28-e580-44f4-b257-ba4b4d7fa223" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Instance network_info: |[{"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] Acquired lock "refresh_cache-a8a87d28-e580-44f4-b257-ba4b4d7fa223" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.network.neutron [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Refreshing network info cache for port f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Start _get_guest_xml network_info=[{"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:27:46 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:27:46 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2062565541',display_name='tempest-AttachVolumeNegativeTest-server-2062565541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2062565541',id=33,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmqL/RA2rC1kBm3Ff5KrAftAjrvhWNZ/OQ5TDfV9dAC2Ccj/MoRUsFjeZcGQJBlDG6A617ip4RQTAT5Ukp1cISoHXEaXM5g0tGPnH9lEp7FMv/jSMqDy+I7uQrZBLhWyg==',key_name='tempest-keypair-362915146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-2p1cxh5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=a8a87d28-e580-44f4-b257-ba4b4d7fa223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3d58c2b-2ae0-4211-8ab8-034c875fd516,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d58c2b-2a') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.objects.instance [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'pci_devices' on Instance uuid a8a87d28-e580-44f4-b257-ba4b4d7fa223 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:27:46 user nova-compute[71482]:   <uuid>a8a87d28-e580-44f4-b257-ba4b4d7fa223</uuid>
Apr 12 09:27:46 user nova-compute[71482]:   <name>instance-00000021</name>
Apr 12 09:27:46 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:27:46 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:27:46 user nova-compute[71482]:   <metadata>
Apr 12 09:27:46 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:27:46 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:27:46 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2062565541</nova:name>
Apr 12 09:27:46 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:27:46</nova:creationTime>
Apr 12 09:27:46 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:27:46 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:27:46 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:27:46 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:27:46 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:27:46 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:27:46 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:27:46 user nova-compute[71482]:       <nova:owner>
Apr 12 09:27:46 user nova-compute[71482]:         <nova:user uuid="5f91fed06f9547d29125f38fe2d47221">tempest-AttachVolumeNegativeTest-395431601-project-member</nova:user>
Apr 12 09:27:46 user nova-compute[71482]:         <nova:project uuid="37b4beaf457f4120bcbcd2b033d5c3db">tempest-AttachVolumeNegativeTest-395431601</nova:project>
Apr 12 09:27:46 user nova-compute[71482]:       </nova:owner>
Apr 12 09:27:46 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:27:46 user nova-compute[71482]:       <nova:ports>
Apr 12 09:27:46 user nova-compute[71482]:         <nova:port uuid="f3d58c2b-2ae0-4211-8ab8-034c875fd516">
Apr 12 09:27:46 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 09:27:46 user nova-compute[71482]:         </nova:port>
Apr 12 09:27:46 user nova-compute[71482]:       </nova:ports>
Apr 12 09:27:46 user nova-compute[71482]:     </nova:instance>
Apr 12 09:27:46 user nova-compute[71482]:   </metadata>
Apr 12 09:27:46 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:27:46 user nova-compute[71482]:     <system>
Apr 12 09:27:46 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:27:46 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:27:46 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:27:46 user nova-compute[71482]:       <entry name="serial">a8a87d28-e580-44f4-b257-ba4b4d7fa223</entry>
Apr 12 09:27:46 user nova-compute[71482]:       <entry name="uuid">a8a87d28-e580-44f4-b257-ba4b4d7fa223</entry>
Apr 12 09:27:46 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:27:46 user nova-compute[71482]:     </system>
Apr 12 09:27:46 user nova-compute[71482]:   </sysinfo>
Apr 12 09:27:46 user nova-compute[71482]:   <os>
Apr 12 09:27:46 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:27:46 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:27:46 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:27:46 user nova-compute[71482]:   </os>
Apr 12 09:27:46 user nova-compute[71482]:   <features>
Apr 12 09:27:46 user nova-compute[71482]:     <acpi/>
Apr 12 09:27:46 user nova-compute[71482]:     <apic/>
Apr 12 09:27:46 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:27:46 user nova-compute[71482]:   </features>
Apr 12 09:27:46 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:27:46 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:27:46 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:27:46 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:27:46 user nova-compute[71482]:   </clock>
Apr 12 09:27:46 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:27:46 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:27:46 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:27:46 user nova-compute[71482]:   </cpu>
Apr 12 09:27:46 user nova-compute[71482]:   <devices>
Apr 12 09:27:46 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:27:46 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:27:46 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk"/>
Apr 12 09:27:46 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:27:46 user nova-compute[71482]:     </disk>
Apr 12 09:27:46 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:27:46 user nova-compute[71482]:       <mac address="fa:16:3e:f1:d8:bc"/>
Apr 12 09:27:46 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:27:46 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:27:46 user nova-compute[71482]:       <target dev="tapf3d58c2b-2a"/>
Apr 12 09:27:46 user nova-compute[71482]:     </interface>
Apr 12 09:27:46 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:27:46 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/console.log" append="off"/>
Apr 12 09:27:46 user nova-compute[71482]:     </serial>
Apr 12 09:27:46 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:27:46 user nova-compute[71482]:     <video>
Apr 12 09:27:46 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:27:46 user nova-compute[71482]:     </video>
Apr 12 09:27:46 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:27:46 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:27:46 user nova-compute[71482]:     </rng>
Apr 12 09:27:46 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:27:46 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:27:46 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:27:46 user nova-compute[71482]:     </memballoon>
Apr 12 09:27:46 user nova-compute[71482]:   </devices>
Apr 12 09:27:46 user nova-compute[71482]: </domain>
Apr 12 09:27:46 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2062565541',display_name='tempest-AttachVolumeNegativeTest-server-2062565541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2062565541',id=33,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmqL/RA2rC1kBm3Ff5KrAftAjrvhWNZ/OQ5TDfV9dAC2Ccj/MoRUsFjeZcGQJBlDG6A617ip4RQTAT5Ukp1cISoHXEaXM5g0tGPnH9lEp7FMv/jSMqDy+I7uQrZBLhWyg==',key_name='tempest-keypair-362915146',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-2p1cxh5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=a8a87d28-e580-44f4-b257-ba4b4d7fa223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3d58c2b-2ae0-4211-8ab8-034c875fd516,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d58c2b-2a') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG os_vif [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3d58c2b-2ae0-4211-8ab8-034c875fd516,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d58c2b-2a') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3d58c2b-2a, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3d58c2b-2a, col_values=(('external_ids', {'iface-id': 'f3d58c2b-2ae0-4211-8ab8-034c875fd516', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:d8:bc', 'vm-uuid': 'a8a87d28-e580-44f4-b257-ba4b4d7fa223'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:46 user nova-compute[71482]: INFO os_vif [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3d58c2b-2ae0-4211-8ab8-034c875fd516,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d58c2b-2a')
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:27:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No VIF found with MAC fa:16:3e:f1:d8:bc, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:27:47 user nova-compute[71482]: DEBUG nova.network.neutron [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Updated VIF entry in instance network info cache for port f3d58c2b-2ae0-4211-8ab8-034c875fd516. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:27:47 user nova-compute[71482]: DEBUG nova.network.neutron [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Updating instance_info_cache with network_info: [{"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:27:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75f1a353-f913-4d7f-9a82-ba45c7579f20 req-75beb5db-c9b9-40f2-bd92-57e85a19b9cb service nova] Releasing lock "refresh_cache-a8a87d28-e580-44f4-b257-ba4b4d7fa223" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] No waiting events found dispatching network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:27:48 user nova-compute[71482]: WARNING nova.compute.manager [req-29f35753-cfdb-4ad8-851c-6fcaa3d434d3 req-d2961134-1286-4245-8e0d-9b06b5dbf833 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received unexpected event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance with vm_state building and task_state spawning.
Apr 12 09:27:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291670.4671574, a8a87d28-e580-44f4-b257-ba4b4d7fa223 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:27:50 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] VM Resumed (Lifecycle Event)
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:27:50 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Instance spawned successfully.
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:27:50 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291670.4673083, a8a87d28-e580-44f4-b257-ba4b4d7fa223 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:27:50 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] VM Started (Lifecycle Event)
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:27:50 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:27:50 user nova-compute[71482]: INFO nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Took 5.41 seconds to spawn the instance on the hypervisor.
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:27:50 user nova-compute[71482]: INFO nova.compute.manager [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Took 6.02 seconds to build instance.
Apr 12 09:27:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-44357e26-0b89-451f-9b86-482538eaad38 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.107s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:27:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] No waiting events found dispatching network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:27:50 user nova-compute[71482]: WARNING nova.compute.manager [req-e7077ca8-3102-4fb1-a64c-97d2b990b207 req-ff1661b0-a926-4b1a-9f4e-340cd24920b8 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received unexpected event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance with vm_state active and task_state None.
Apr 12 09:27:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid a569c652-6b15-4244-b011-1d09fbdd4281 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updating instance_info_cache with network_info: [{"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-a569c652-6b15-4244-b011-1d09fbdd4281" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:27:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:27:57 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:27:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:28:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:09 user nova-compute[71482]: INFO nova.compute.manager [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Terminating instance
Apr 12 09:28:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received event network-vif-unplugged-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] Acquiring lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] No waiting events found dispatching network-vif-unplugged-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-483b6bcf-9847-48cf-9250-19e33566cf67 req-87ef2966-61e4-4c43-846b-7d5bcefd66f7 service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received event network-vif-unplugged-69806c5e-19dc-4012-b62c-133ad94c3800 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:10 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Instance destroyed successfully.
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lazy-loading 'resources' on Instance uuid 767f53f6-4a39-4ba7-ba02-105344e5c6fc {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:26:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1709160961',display_name='tempest-VolumesActionsTest-instance-1709160961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1709160961',id=31,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f752416df0d043a4b82b204a780f597c',ramdisk_id='',reservation_id='r-7bv5bsur',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-902475152',owner_user_name='tempest-VolumesActionsTest-902475152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:26:26Z,user_data=None,user_id='e432c3374fe34540b47999d4cc361e0e',uuid=767f53f6-4a39-4ba7-ba02-105344e5c6fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converting VIF {"id": "69806c5e-19dc-4012-b62c-133ad94c3800", "address": "fa:16:3e:11:7d:51", "network": {"id": "a3466e34-4121-4696-b68e-404c7e7dc5a4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1135418609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "f752416df0d043a4b82b204a780f597c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69806c5e-19", "ovs_interfaceid": "69806c5e-19dc-4012-b62c-133ad94c3800", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=69806c5e-19dc-4012-b62c-133ad94c3800,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69806c5e-19') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG os_vif [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=69806c5e-19dc-4012-b62c-133ad94c3800,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69806c5e-19') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69806c5e-19, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:28:10 user nova-compute[71482]: INFO os_vif [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:7d:51,bridge_name='br-int',has_traffic_filtering=True,id=69806c5e-19dc-4012-b62c-133ad94c3800,network=Network(a3466e34-4121-4696-b68e-404c7e7dc5a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69806c5e-19')
Apr 12 09:28:10 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Deleting instance files /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc_del
Apr 12 09:28:10 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Deletion of /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc_del complete
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk --force-share --output=json" returned: 1 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] '/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk --force-share --output=json' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:28:10 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001f, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/767f53f6-4a39-4ba7-ba02-105344e5c6fc/disk
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:10 user nova-compute[71482]: INFO nova.compute.manager [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Took 0.76 seconds to destroy the instance on the hypervisor.
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:11 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:28:11 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8146MB free_disk=26.23407745361328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:28:11 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Took 0.72 seconds to deallocate network for instance.
Apr 12 09:28:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Applying migration context for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb as it has an incoming, in-progress migration aeb9c6a7-edb3-40f0-9f4e-d0c076fc22ff. Migration status is finished {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 12 09:28:11 user nova-compute[71482]: INFO nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating resource usage from migration aeb9c6a7-edb3-40f0-9f4e-d0c076fc22ff
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a569c652-6b15-4244-b011-1d09fbdd4281 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Migration aeb9c6a7-edb3-40f0-9f4e-d0c076fc22ff is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.309s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:28:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:12 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Deleted allocations for instance 767f53f6-4a39-4ba7-ba02-105344e5c6fc
Apr 12 09:28:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received event network-vif-plugged-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] Acquiring lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] No waiting events found dispatching network-vif-plugged-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:28:12 user nova-compute[71482]: WARNING nova.compute.manager [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received unexpected event network-vif-plugged-69806c5e-19dc-4012-b62c-133ad94c3800 for instance with vm_state deleted and task_state None.
Apr 12 09:28:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-4502fb9d-ecdd-41ea-9645-e3c8bafe99e6 req-71134667-fb1e-4293-871a-1a9abeda51bc service nova] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Received event network-vif-deleted-69806c5e-19dc-4012-b62c-133ad94c3800 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b1e6a32b-d29a-4dec-89cf-10dea44d5d12 tempest-VolumesActionsTest-902475152 tempest-VolumesActionsTest-902475152-project-member] Lock "767f53f6-4a39-4ba7-ba02-105344e5c6fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.596s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "a569c652-6b15-4244-b011-1d09fbdd4281" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "a569c652-6b15-4244-b011-1d09fbdd4281" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:12 user nova-compute[71482]: INFO nova.compute.manager [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Terminating instance
Apr 12 09:28:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received event network-vif-unplugged-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] Acquiring lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] No waiting events found dispatching network-vif-unplugged-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:28:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-a9c7aa64-c186-41d5-b779-c879b60ef3dc req-66f63920-47d7-4308-963c-34ddc983b95b service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received event network-vif-unplugged-b2a3049a-cc8d-4804-854e-2451b7f886fd for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:28:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Instance destroyed successfully.
Apr 12 09:28:13 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lazy-loading 'resources' on Instance uuid a569c652-6b15-4244-b011-1d09fbdd4281 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:08:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1499919168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1499919168',id=1,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6ce4a0f4dad40c18fd8a83470c15f05',ramdisk_id='',reservation_id='r-mzwztiq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:10:36Z,user_data=None,user_id='cc51704e74b045ad9733a43aec982390',uuid=a569c652-6b15-4244-b011-1d09fbdd4281,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:28:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converting VIF {"id": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "address": "fa:16:3e:af:5c:42", "network": {"id": "a0210d9b-0f71-4647-9f96-c9cbe32cc3d8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1621426958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6ce4a0f4dad40c18fd8a83470c15f05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a3049a-cc", "ovs_interfaceid": "b2a3049a-cc8d-4804-854e-2451b7f886fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:28:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:5c:42,bridge_name='br-int',has_traffic_filtering=True,id=b2a3049a-cc8d-4804-854e-2451b7f886fd,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a3049a-cc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:28:13 user nova-compute[71482]: DEBUG os_vif [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:5c:42,bridge_name='br-int',has_traffic_filtering=True,id=b2a3049a-cc8d-4804-854e-2451b7f886fd,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a3049a-cc') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:28:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2a3049a-cc, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:28:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:28:13 user nova-compute[71482]: INFO os_vif [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:5c:42,bridge_name='br-int',has_traffic_filtering=True,id=b2a3049a-cc8d-4804-854e-2451b7f886fd,network=Network(a0210d9b-0f71-4647-9f96-c9cbe32cc3d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a3049a-cc')
Apr 12 09:28:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Deleting instance files /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281_del
Apr 12 09:28:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Deletion of /opt/stack/data/nova/instances/a569c652-6b15-4244-b011-1d09fbdd4281_del complete
Apr 12 09:28:13 user nova-compute[71482]: INFO nova.compute.manager [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 12 09:28:13 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:28:13 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:28:13 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:28:14 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Took 0.45 seconds to deallocate network for instance.
Apr 12 09:28:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-6d4e4647-d5fe-4679-a37a-2b023741ed26 req-02ea813e-b7f6-4390-ae12-620b052da552 service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received event network-vif-deleted-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:14 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Deleted allocations for instance a569c652-6b15-4244-b011-1d09fbdd4281
Apr 12 09:28:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2817147a-a7eb-4a36-96c9-e45f066ac612 tempest-ServerBootFromVolumeStableRescueTest-1244466684 tempest-ServerBootFromVolumeStableRescueTest-1244466684-project-member] Lock "a569c652-6b15-4244-b011-1d09fbdd4281" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received event network-vif-plugged-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] Acquiring lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] Lock "a569c652-6b15-4244-b011-1d09fbdd4281-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] No waiting events found dispatching network-vif-plugged-b2a3049a-cc8d-4804-854e-2451b7f886fd {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:28:14 user nova-compute[71482]: WARNING nova.compute.manager [req-7fcea695-1352-494a-9a41-b933826bb72c req-8696a6c8-82e4-4598-8556-4be0aea98df1 service nova] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Received unexpected event network-vif-plugged-b2a3049a-cc8d-4804-854e-2451b7f886fd for instance with vm_state deleted and task_state None.
Apr 12 09:28:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:25 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291690.4525154, 767f53f6-4a39-4ba7-ba02-105344e5c6fc => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:28:25 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] VM Stopped (Lifecycle Event)
Apr 12 09:28:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-5e9fe919-d43c-4e6c-85d5-1fc94e5a58fa None None] [instance: 767f53f6-4a39-4ba7-ba02-105344e5c6fc] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:28:28 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291693.3666263, a569c652-6b15-4244-b011-1d09fbdd4281 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:28:28 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] VM Stopped (Lifecycle Event)
Apr 12 09:28:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f34a30cb-b6cb-4664-9690-31d19e2087f2 None None] [instance: a569c652-6b15-4244-b011-1d09fbdd4281] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:28:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:28:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:28:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:28:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:28:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:32 user nova-compute[71482]: INFO nova.compute.manager [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Unshelving
Apr 12 09:28:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:32 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'pci_requests' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:32 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:32 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:28:32 user nova-compute[71482]: INFO nova.compute.claims [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Claim successful on node user
Apr 12 09:28:32 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:28:32 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:28:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:32 user nova-compute[71482]: INFO nova.network.neutron [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updating port 2c0316e9-6065-4c8c-8e7d-8d02f54d0083 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquired lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-changed-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG nova.compute.manager [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Refreshing instance network info cache due to event network-changed-2c0316e9-6065-4c8c-8e7d-8d02f54d0083. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] Acquiring lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG nova.network.neutron [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updating instance_info_cache with network_info: [{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Releasing lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:28:33 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Creating image(s)
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] Acquired lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG nova.network.neutron [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Refreshing network info cache for port 2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "915f731fd6975e8bbfda78390efd1d200d4e9ee8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "915f731fd6975e8bbfda78390efd1d200d4e9ee8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8.part --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG nova.virt.images [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] a385a44d-4df5-4e6e-a6cb-8f03ffa1b3f4 was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8.part /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG nova.network.neutron [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updated VIF entry in instance network info cache for port 2c0316e9-6065-4c8c-8e7d-8d02f54d0083. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG nova.network.neutron [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updating instance_info_cache with network_info: [{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-64539629-c703-4359-9fb1-01c0300f8aec req-0dbf875c-fc69-4c9f-8bfd-e10d8d53519d service nova] Releasing lock "refresh_cache-8a52d45c-9ce4-4e4f-973a-fffce9f85bef" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8.part /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8.converted" returned: 0 in 0.296s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8.converted --force-share --output=json" returned: 0 in 0.163s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "915f731fd6975e8bbfda78390efd1d200d4e9ee8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.292s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8 --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "915f731fd6975e8bbfda78390efd1d200d4e9ee8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "915f731fd6975e8bbfda78390efd1d200d4e9ee8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8 --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8,backing_fmt=raw /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8,backing_fmt=raw /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk 1073741824" returned: 0 in 0.054s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "915f731fd6975e8bbfda78390efd1d200d4e9ee8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8 --force-share --output=json" returned: 0 in 0.126s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'migration_context' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:35 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Rebasing disk image.
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 -F raw /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 -F raw /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk" returned: 0 in 2.050s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Ensure instance console log exists: /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Start _get_guest_xml network_info=[{"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f892b069b13d949a3eba3c83f7723696',container_format='bare',created_at=2023-04-12T09:26:40Z,direct_url=<?>,disk_format='qcow2',id=a385a44d-4df5-4e6e-a6cb-8f03ffa1b3f4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-368249722-shelved',owner='6ebfa64bb5194b859821a77de6805d2d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T09:26:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:28:37 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:28:37 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f892b069b13d949a3eba3c83f7723696',container_format='bare',created_at=2023-04-12T09:26:40Z,direct_url=<?>,disk_format='qcow2',id=a385a44d-4df5-4e6e-a6cb-8f03ffa1b3f4,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-368249722-shelved',owner='6ebfa64bb5194b859821a77de6805d2d',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-12T09:26:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368249722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368249722',id=29,image_ref='a385a44d-4df5-4e6e-a6cb-8f03ffa1b3f4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-202654117',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:24:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-i7mje20m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member',shelved_at='2023-04-12T09:26:43.377665',shelved_host='user',shelved_image_id='a385a44d-4df5-4e6e-a6cb-8f03ffa1b3f4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:28:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=8a52d45c-9ce4-4e4f-973a-fffce9f85bef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:28:37 user nova-compute[71482]:   <uuid>8a52d45c-9ce4-4e4f-973a-fffce9f85bef</uuid>
Apr 12 09:28:37 user nova-compute[71482]:   <name>instance-0000001d</name>
Apr 12 09:28:37 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:28:37 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:28:37 user nova-compute[71482]:   <metadata>
Apr 12 09:28:37 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:28:37 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:28:37 user nova-compute[71482]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-368249722</nova:name>
Apr 12 09:28:37 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:28:37</nova:creationTime>
Apr 12 09:28:37 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:28:37 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:28:37 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:28:37 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:28:37 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:28:37 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:28:37 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:28:37 user nova-compute[71482]:       <nova:owner>
Apr 12 09:28:37 user nova-compute[71482]:         <nova:user uuid="d76daece06a943668e6c1c3c2c57ebaa">tempest-AttachVolumeShelveTestJSON-72439030-project-member</nova:user>
Apr 12 09:28:37 user nova-compute[71482]:         <nova:project uuid="6ebfa64bb5194b859821a77de6805d2d">tempest-AttachVolumeShelveTestJSON-72439030</nova:project>
Apr 12 09:28:37 user nova-compute[71482]:       </nova:owner>
Apr 12 09:28:37 user nova-compute[71482]:       <nova:root type="image" uuid="a385a44d-4df5-4e6e-a6cb-8f03ffa1b3f4"/>
Apr 12 09:28:37 user nova-compute[71482]:       <nova:ports>
Apr 12 09:28:37 user nova-compute[71482]:         <nova:port uuid="2c0316e9-6065-4c8c-8e7d-8d02f54d0083">
Apr 12 09:28:37 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 09:28:37 user nova-compute[71482]:         </nova:port>
Apr 12 09:28:37 user nova-compute[71482]:       </nova:ports>
Apr 12 09:28:37 user nova-compute[71482]:     </nova:instance>
Apr 12 09:28:37 user nova-compute[71482]:   </metadata>
Apr 12 09:28:37 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:28:37 user nova-compute[71482]:     <system>
Apr 12 09:28:37 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:28:37 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:28:37 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:28:37 user nova-compute[71482]:       <entry name="serial">8a52d45c-9ce4-4e4f-973a-fffce9f85bef</entry>
Apr 12 09:28:37 user nova-compute[71482]:       <entry name="uuid">8a52d45c-9ce4-4e4f-973a-fffce9f85bef</entry>
Apr 12 09:28:37 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:28:37 user nova-compute[71482]:     </system>
Apr 12 09:28:37 user nova-compute[71482]:   </sysinfo>
Apr 12 09:28:37 user nova-compute[71482]:   <os>
Apr 12 09:28:37 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:28:37 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:28:37 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:28:37 user nova-compute[71482]:   </os>
Apr 12 09:28:37 user nova-compute[71482]:   <features>
Apr 12 09:28:37 user nova-compute[71482]:     <acpi/>
Apr 12 09:28:37 user nova-compute[71482]:     <apic/>
Apr 12 09:28:37 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:28:37 user nova-compute[71482]:   </features>
Apr 12 09:28:37 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:28:37 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:28:37 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:28:37 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:28:37 user nova-compute[71482]:   </clock>
Apr 12 09:28:37 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:28:37 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:28:37 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:28:37 user nova-compute[71482]:   </cpu>
Apr 12 09:28:37 user nova-compute[71482]:   <devices>
Apr 12 09:28:37 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:28:37 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:28:37 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk"/>
Apr 12 09:28:37 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:28:37 user nova-compute[71482]:     </disk>
Apr 12 09:28:37 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:28:37 user nova-compute[71482]:       <mac address="fa:16:3e:27:9c:2b"/>
Apr 12 09:28:37 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:28:37 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:28:37 user nova-compute[71482]:       <target dev="tap2c0316e9-60"/>
Apr 12 09:28:37 user nova-compute[71482]:     </interface>
Apr 12 09:28:37 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:28:37 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/console.log" append="off"/>
Apr 12 09:28:37 user nova-compute[71482]:     </serial>
Apr 12 09:28:37 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:28:37 user nova-compute[71482]:     <video>
Apr 12 09:28:37 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:28:37 user nova-compute[71482]:     </video>
Apr 12 09:28:37 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:28:37 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:28:37 user nova-compute[71482]:     </rng>
Apr 12 09:28:37 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:28:37 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:28:37 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:28:37 user nova-compute[71482]:     </memballoon>
Apr 12 09:28:37 user nova-compute[71482]:   </devices>
Apr 12 09:28:37 user nova-compute[71482]: </domain>
Apr 12 09:28:37 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368249722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368249722',id=29,image_ref='a385a44d-4df5-4e6e-a6cb-8f03ffa1b3f4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-202654117',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:24:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-i7mje20m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member',shelved_at='2023-04-12T09:26:43.377665',shelved_host='user',shelved_image_id='a385a44d-4df5-4e6e-a6cb-8f03ffa1b3f4'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:28:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=8a52d45c-9ce4-4e4f-973a-fffce9f85bef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG os_vif [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c0316e9-60, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c0316e9-60, col_values=(('external_ids', {'iface-id': '2c0316e9-6065-4c8c-8e7d-8d02f54d0083', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:9c:2b', 'vm-uuid': '8a52d45c-9ce4-4e4f-973a-fffce9f85bef'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:37 user nova-compute[71482]: INFO os_vif [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60')
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:28:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] No VIF found with MAC fa:16:3e:27:9c:2b, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] No waiting events found dispatching network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:28:39 user nova-compute[71482]: WARNING nova.compute.manager [req-109d5437-38f0-4475-8031-816baeb93256 req-d6fd4b8c-8b16-464e-8f44-19f19fb20fdc service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received unexpected event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 09:28:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291721.374511, 8a52d45c-9ce4-4e4f-973a-fffce9f85bef => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:28:41 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] VM Resumed (Lifecycle Event)
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:28:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance spawned successfully.
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:28:41 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291721.37646, 8a52d45c-9ce4-4e4f-973a-fffce9f85bef => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:28:41 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] VM Started (Lifecycle Event)
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:28:41 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] No waiting events found dispatching network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:28:41 user nova-compute[71482]: WARNING nova.compute.manager [req-4459404a-7f70-4915-b919-6a782b0e49e3 req-a949c99f-97a8-4ac4-90de-1ab5cbd98a9e service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received unexpected event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 09:28:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:28:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-b31d572c-8c47-4797-a446-6da0a36b9a76 tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 9.558s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "57fc5db7-8577-4a55-a511-d9f25db0a43c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:45 user nova-compute[71482]: DEBUG nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:28:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:28:45 user nova-compute[71482]: INFO nova.compute.claims [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Claim successful on node user
Apr 12 09:28:45 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:28:45 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:28:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:45 user nova-compute[71482]: DEBUG nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:28:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.policy [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '741e227a2cc7425d8b171c2a04989191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcea1b997ee6450dbf603305d2812f7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:28:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Creating image(s)
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "/opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "/opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "/opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.159s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk 1073741824" returned: 0 in 0.045s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.181s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Successfully created port: 10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Cannot resize image /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.objects.instance [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lazy-loading 'migration_context' on Instance uuid 57fc5db7-8577-4a55-a511-d9f25db0a43c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Ensure instance console log exists: /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Successfully updated port: 10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "refresh_cache-57fc5db7-8577-4a55-a511-d9f25db0a43c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquired lock "refresh_cache-57fc5db7-8577-4a55-a511-d9f25db0a43c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received event network-changed-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Refreshing instance network info cache due to event network-changed-10aaf934-db80-40bb-9b6c-464151693b9c. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] Acquiring lock "refresh_cache-57fc5db7-8577-4a55-a511-d9f25db0a43c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Updating instance_info_cache with network_info: [{"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Releasing lock "refresh_cache-57fc5db7-8577-4a55-a511-d9f25db0a43c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Instance network_info: |[{"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] Acquired lock "refresh_cache-57fc5db7-8577-4a55-a511-d9f25db0a43c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG nova.network.neutron [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Refreshing network info cache for port 10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:28:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Start _get_guest_xml network_info=[{"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:28:48 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:28:48 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2004437417',display_name='tempest-ServersNegativeTestJSON-server-2004437417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2004437417',id=34,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcea1b997ee6450dbf603305d2812f7f',ramdisk_id='',reservation_id='r-tpf8igce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1848567648',owner_user_name='tempest-ServersNegativeTestJSON-1848567648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:28:46Z,user_data=None,user_id='741e227a2cc7425d8b171c2a04989191',uuid=57fc5db7-8577-4a55-a511-d9f25db0a43c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converting VIF {"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:bf:65,bridge_name='br-int',has_traffic_filtering=True,id=10aaf934-db80-40bb-9b6c-464151693b9c,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10aaf934-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.objects.instance [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lazy-loading 'pci_devices' on Instance uuid 57fc5db7-8577-4a55-a511-d9f25db0a43c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:28:48 user nova-compute[71482]:   <uuid>57fc5db7-8577-4a55-a511-d9f25db0a43c</uuid>
Apr 12 09:28:48 user nova-compute[71482]:   <name>instance-00000022</name>
Apr 12 09:28:48 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:28:48 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:28:48 user nova-compute[71482]:   <metadata>
Apr 12 09:28:48 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:28:48 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:28:48 user nova-compute[71482]:       <nova:name>tempest-ServersNegativeTestJSON-server-2004437417</nova:name>
Apr 12 09:28:48 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:28:48</nova:creationTime>
Apr 12 09:28:48 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:28:48 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:28:48 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:28:48 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:28:48 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:28:48 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:28:48 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:28:48 user nova-compute[71482]:       <nova:owner>
Apr 12 09:28:48 user nova-compute[71482]:         <nova:user uuid="741e227a2cc7425d8b171c2a04989191">tempest-ServersNegativeTestJSON-1848567648-project-member</nova:user>
Apr 12 09:28:48 user nova-compute[71482]:         <nova:project uuid="dcea1b997ee6450dbf603305d2812f7f">tempest-ServersNegativeTestJSON-1848567648</nova:project>
Apr 12 09:28:48 user nova-compute[71482]:       </nova:owner>
Apr 12 09:28:48 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:28:48 user nova-compute[71482]:       <nova:ports>
Apr 12 09:28:48 user nova-compute[71482]:         <nova:port uuid="10aaf934-db80-40bb-9b6c-464151693b9c">
Apr 12 09:28:48 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 12 09:28:48 user nova-compute[71482]:         </nova:port>
Apr 12 09:28:48 user nova-compute[71482]:       </nova:ports>
Apr 12 09:28:48 user nova-compute[71482]:     </nova:instance>
Apr 12 09:28:48 user nova-compute[71482]:   </metadata>
Apr 12 09:28:48 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:28:48 user nova-compute[71482]:     <system>
Apr 12 09:28:48 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:28:48 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:28:48 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:28:48 user nova-compute[71482]:       <entry name="serial">57fc5db7-8577-4a55-a511-d9f25db0a43c</entry>
Apr 12 09:28:48 user nova-compute[71482]:       <entry name="uuid">57fc5db7-8577-4a55-a511-d9f25db0a43c</entry>
Apr 12 09:28:48 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:28:48 user nova-compute[71482]:     </system>
Apr 12 09:28:48 user nova-compute[71482]:   </sysinfo>
Apr 12 09:28:48 user nova-compute[71482]:   <os>
Apr 12 09:28:48 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:28:48 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:28:48 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:28:48 user nova-compute[71482]:   </os>
Apr 12 09:28:48 user nova-compute[71482]:   <features>
Apr 12 09:28:48 user nova-compute[71482]:     <acpi/>
Apr 12 09:28:48 user nova-compute[71482]:     <apic/>
Apr 12 09:28:48 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:28:48 user nova-compute[71482]:   </features>
Apr 12 09:28:48 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:28:48 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:28:48 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:28:48 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:28:48 user nova-compute[71482]:   </clock>
Apr 12 09:28:48 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:28:48 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:28:48 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:28:48 user nova-compute[71482]:   </cpu>
Apr 12 09:28:48 user nova-compute[71482]:   <devices>
Apr 12 09:28:48 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:28:48 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:28:48 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk"/>
Apr 12 09:28:48 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:28:48 user nova-compute[71482]:     </disk>
Apr 12 09:28:48 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:28:48 user nova-compute[71482]:       <mac address="fa:16:3e:41:bf:65"/>
Apr 12 09:28:48 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:28:48 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:28:48 user nova-compute[71482]:       <target dev="tap10aaf934-db"/>
Apr 12 09:28:48 user nova-compute[71482]:     </interface>
Apr 12 09:28:48 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:28:48 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/console.log" append="off"/>
Apr 12 09:28:48 user nova-compute[71482]:     </serial>
Apr 12 09:28:48 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:28:48 user nova-compute[71482]:     <video>
Apr 12 09:28:48 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:28:48 user nova-compute[71482]:     </video>
Apr 12 09:28:48 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:28:48 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:28:48 user nova-compute[71482]:     </rng>
Apr 12 09:28:48 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:28:48 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:28:48 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:28:48 user nova-compute[71482]:     </memballoon>
Apr 12 09:28:48 user nova-compute[71482]:   </devices>
Apr 12 09:28:48 user nova-compute[71482]: </domain>
Apr 12 09:28:48 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2004437417',display_name='tempest-ServersNegativeTestJSON-server-2004437417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2004437417',id=34,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcea1b997ee6450dbf603305d2812f7f',ramdisk_id='',reservation_id='r-tpf8igce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1848567648',owner_user_name='tempest-ServersNegativeTestJSON-1848567648-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:28:46Z,user_data=None,user_id='741e227a2cc7425d8b171c2a04989191',uuid=57fc5db7-8577-4a55-a511-d9f25db0a43c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converting VIF {"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:bf:65,bridge_name='br-int',has_traffic_filtering=True,id=10aaf934-db80-40bb-9b6c-464151693b9c,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10aaf934-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG os_vif [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:bf:65,bridge_name='br-int',has_traffic_filtering=True,id=10aaf934-db80-40bb-9b6c-464151693b9c,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10aaf934-db') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10aaf934-db, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap10aaf934-db, col_values=(('external_ids', {'iface-id': '10aaf934-db80-40bb-9b6c-464151693b9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:bf:65', 'vm-uuid': '57fc5db7-8577-4a55-a511-d9f25db0a43c'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:48 user nova-compute[71482]: INFO os_vif [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:bf:65,bridge_name='br-int',has_traffic_filtering=True,id=10aaf934-db80-40bb-9b6c-464151693b9c,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10aaf934-db')
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] No VIF found with MAC fa:16:3e:41:bf:65, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Updated VIF entry in instance network info cache for port 10aaf934-db80-40bb-9b6c-464151693b9c. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Updating instance_info_cache with network_info: [{"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:28:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-36f45e67-4fae-4ef5-a609-abfbb3581200 req-7ec34bf8-bd11-4ce3-a600-700be69c039b service nova] Releasing lock "refresh_cache-57fc5db7-8577-4a55-a511-d9f25db0a43c" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:28:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received event network-vif-plugged-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] Acquiring lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:49 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:49 user nova-compute[71482]: DEBUG nova.compute.manager [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] No waiting events found dispatching network-vif-plugged-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:28:49 user nova-compute[71482]: WARNING nova.compute.manager [req-71a89faa-04b7-4537-990d-8c3a2dea39b5 req-8b19c73b-442e-4308-8140-fc5b1f177628 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received unexpected event network-vif-plugged-10aaf934-db80-40bb-9b6c-464151693b9c for instance with vm_state building and task_state spawning.
Apr 12 09:28:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291731.6559503, 57fc5db7-8577-4a55-a511-d9f25db0a43c => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:28:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] VM Resumed (Lifecycle Event)
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:28:51 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Instance spawned successfully.
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:28:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291731.6596553, 57fc5db7-8577-4a55-a511-d9f25db0a43c => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:28:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] VM Started (Lifecycle Event)
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:28:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received event network-vif-plugged-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] Acquiring lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] No waiting events found dispatching network-vif-plugged-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:28:51 user nova-compute[71482]: WARNING nova.compute.manager [req-06c08f2a-536e-447f-a43d-6e9326fc71e2 req-a3c74bab-2712-4023-98ae-5086205e6826 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received unexpected event network-vif-plugged-10aaf934-db80-40bb-9b6c-464151693b9c for instance with vm_state building and task_state spawning.
Apr 12 09:28:51 user nova-compute[71482]: INFO nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Took 5.63 seconds to spawn the instance on the hypervisor.
Apr 12 09:28:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:28:51 user nova-compute[71482]: INFO nova.compute.manager [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Took 6.26 seconds to build instance.
Apr 12 09:28:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-79f78f1d-bd21-4b89-bc0a-52e5085ae1fa tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.349s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Going to confirm migration 2 {{(pid=71482) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquired lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'info_cache' on Instance uuid 6720b589-6dc8-460a-bdc2-52b9b1cd77fb {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating instance_info_cache with network_info: [{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Releasing lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG nova.objects.instance [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'migration_context' on Instance uuid 6720b589-6dc8-460a-bdc2-52b9b1cd77fb {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:28:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:28:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:53 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:28:53 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:28:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.373s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:53 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Deleted allocation for migration aeb9c6a7-edb3-40f0-9f4e-d0c076fc22ff
Apr 12 09:28:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9348f84f-d304-4075-a5fa-cdc7281760b2 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.299s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:28:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:57 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:57 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:57 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:28:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:28:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:28:57 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:28:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:28:58 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updating instance_info_cache with network_info: [{"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:28:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-d2be3178-85b4-4012-a7d0-2d8543a65a42" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:28:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:28:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:28:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:29:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:29:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:29:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:29:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:29:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:13 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:29:13 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:29:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8215MB free_disk=26.165477752685547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:29:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1344MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:29:14 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:29:14 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:29:14 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:29:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:29:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-changed-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:29:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Refreshing instance network info cache due to event network-changed-f3d58c2b-2ae0-4211-8ab8-034c875fd516. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:29:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] Acquiring lock "refresh_cache-a8a87d28-e580-44f4-b257-ba4b4d7fa223" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:29:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] Acquired lock "refresh_cache-a8a87d28-e580-44f4-b257-ba4b4d7fa223" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:29:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Refreshing network info cache for port f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:29:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Updated VIF entry in instance network info cache for port f3d58c2b-2ae0-4211-8ab8-034c875fd516. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:29:36 user nova-compute[71482]: DEBUG nova.network.neutron [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Updating instance_info_cache with network_info: [{"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:29:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cde07ab0-7bec-476d-b0e4-b199ff6048d3 req-91f7d9f6-00b1-4dab-9754-feb2ab4bdb96 service nova] Releasing lock "refresh_cache-a8a87d28-e580-44f4-b257-ba4b4d7fa223" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'flavor' on Instance uuid a8a87d28-e580-44f4-b257-ba4b4d7fa223 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:29:37 user nova-compute[71482]: INFO nova.compute.manager [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Attaching volume 151e2c1a-196e-4e20-af6f-76ebb0f3ed9c to /dev/vdb
Apr 12 09:29:37 user nova-compute[71482]: DEBUG os_brick.utils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bca46e-e294-4b59-b87b-165d39b36d5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb51e3-febd-4a51-a5a7-c88aefbec32e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.045s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d6b4b-72b0-4cc5-acfc-0ada95dea376]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29ab7a5-3a6d-4dfd-bc22-3677994fd789]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:29:37 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:29:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a0385d-0871-498a-9cd7-c5104d1d9d0e]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG os_brick.utils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:29:37 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Updating existing volume attachment record: f50dd01a-948d-4659-af58-240bc25aa988 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:29:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxzHLthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:29:42 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:29:42 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:29:42 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[05609ee6-71e9-457c-a313-b299e9fd792f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:29:42 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[359efa02-17f9-430d-809c-c180f281833c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c] added
Apr 12 09:29:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[902cd82c-426b-4754-a0c9-debd39550ed9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9354aa-56e6-44fe-9743-43fd66545080]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxzHLthQ {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bxzHLthQ" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4c110c-1952-41b4-948f-741bcfa16a0b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bxzHLthQ'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4548b69e-ffb3-4e33-bca4-7027acd670e0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[111db125-d866-4dbf-9951-96cff2b7361d]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:29:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:29:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf208c26-754d-42f4-9750-347ec00dc4ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c, portal: 172.16.0.220,3260]
Apr 12 09:29:42 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c, portal: 172.16.0.220,3260] successful.
Apr 12 09:29:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed9eb2a-5b99-4c6a-aec0-164fb7ad4fdd]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6730f6b-bda0-486a-9c7f-d4c970afb0bc]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:29:42 user nova-compute[71482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c (non-flash)
Apr 12 09:29:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:29:42 user nova-compute[71482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c (non-flash)
Apr 12 09:29:42 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aae57a-2c0f-4b5f-98bb-e9044b4eb635]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:29:42 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxzHLthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:29:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:29:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23833663765356536', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:29:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833663765356536', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:29:43 user nova-compute[71482]: DEBUG nova.objects.instance [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'flavor' on Instance uuid a8a87d28-e580-44f4-b257-ba4b4d7fa223 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:29:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:29:43 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:29:43 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:29:43 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:29:43 user nova-compute[71482]:   <serial>151e2c1a-196e-4e20-af6f-76ebb0f3ed9c</serial>
Apr 12 09:29:43 user nova-compute[71482]: </disk>
Apr 12 09:29:43 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:29:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:29:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:29:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] No VIF found with MAC fa:16:3e:f1:d8:bc, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:29:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-be83a87c-2802-4732-9a02-25015ccb10b4 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.653s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:29:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:29:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:29:45 user nova-compute[71482]: INFO nova.compute.manager [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Detaching volume 151e2c1a-196e-4e20-af6f-76ebb0f3ed9c
Apr 12 09:29:45 user nova-compute[71482]: INFO nova.virt.block_device [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Attempting to driver detach volume 151e2c1a-196e-4e20-af6f-76ebb0f3ed9c from mountpoint /dev/vdb
Apr 12 09:29:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Attempting to detach device vdb from instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:29:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:29:45 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:29:45 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:29:45 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:29:45 user nova-compute[71482]:   <serial>151e2c1a-196e-4e20-af6f-76ebb0f3ed9c</serial>
Apr 12 09:29:45 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:29:45 user nova-compute[71482]: </disk>
Apr 12 09:29:45 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:29:45 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully detached device vdb from instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 from the persistent domain config.
Apr 12 09:29:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:29:45 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:29:45 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:29:45 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:29:45 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:29:45 user nova-compute[71482]:   <serial>151e2c1a-196e-4e20-af6f-76ebb0f3ed9c</serial>
Apr 12 09:29:45 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:29:45 user nova-compute[71482]: </disk>
Apr 12 09:29:45 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681291786.2323816, a8a87d28-e580-44f4-b257-ba4b4d7fa223 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:29:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully detached device vdb from instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 from the live domain config.
Apr 12 09:29:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bxzHLthQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:29:46 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d988093-d5d0-495b-a398-c2284660b44e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:29:46 user nova-compute[71482]: No targets found.
Apr 12 09:29:46 user nova-compute[71482]: iSNS:
Apr 12 09:29:46 user nova-compute[71482]: No targets found.
Apr 12 09:29:46 user nova-compute[71482]: STATIC:
Apr 12 09:29:46 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2
Apr 12 09:29:46 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:29:46 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:29:46 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c
Apr 12 09:29:46 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:29:46 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:29:46 user nova-compute[71482]: FIRMWARE:
Apr 12 09:29:46 user nova-compute[71482]: No targets found.
Apr 12 09:29:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:29:46 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:29:46 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec676e3-5a22-40d6-8d7c-9c5f44b31c68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0265d412-c17b-4f7a-a48a-d8b123e44c66]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:29:46 user nova-compute[71482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c (non-flash)
Apr 12 09:29:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:29:46 user nova-compute[71482]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c (non-flash)
Apr 12 09:29:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f930872acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b3dc9-f187-4ed1-beb3-7899e263e222]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[037a1815-f580-4c46-a70c-52a137d76182]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a96f2d-12d5-4823-9f55-d9333aee777b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4720b6bc-9f94-4ce3-a562-7e4108bb7313]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d42e05e-feb6-476c-9a97-50ce90445778]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5003612c-b73a-4c99-9cf0-9dce00c96edc]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c, portal: 172.16.0.220,3260]
Apr 12 09:29:46 user nova-compute[71482]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c, portal: 172.16.0.220,3260] successful.
Apr 12 09:29:46 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:151e2c1a-196e-4e20-af6f-76ebb0f3ed9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3fe996-738d-455f-83bd-d4de2c3afc0c]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] <== disconnect_volume: return (321ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:29:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:29:47 user nova-compute[71482]: DEBUG nova.objects.instance [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'flavor' on Instance uuid a8a87d28-e580-44f4-b257-ba4b4d7fa223 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:29:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1b352086-d39b-4f5c-9aea-1388da2f4043 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.773s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:29:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:29:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:29:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:29:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:29:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:29:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating instance_info_cache with network_info: [{"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-6720b589-6dc8-460a-bdc2-52b9b1cd77fb" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:02 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:30:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:30:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:30:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:30:14 user nova-compute[71482]: INFO nova.compute.claims [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Claim successful on node user
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:30:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:14 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.policy [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:30:15 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:30:15 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8250MB free_disk=26.289920806884766GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:15 user nova-compute[71482]: INFO nova.virt.block_device [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Booting with volume snapshot 2624d977-6b5d-49b6-85b5-16ffb1c9dfc7 at /dev/vda
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a8a87d28-e580-44f4-b257-ba4b4d7fa223 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 57fc5db7-8577-4a55-a511-d9f25db0a43c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:15 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Successfully created port: ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:30:16 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Successfully updated port: ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:30:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "refresh_cache-a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:30:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquired lock "refresh_cache-a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:30:16 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:30:16 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:30:16 user nova-compute[71482]: DEBUG nova.compute.manager [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received event network-changed-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:16 user nova-compute[71482]: DEBUG nova.compute.manager [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Refreshing instance network info cache due to event network-changed-ba9d50c6-6711-4652-bb0a-7a020a9b68e3. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:30:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] Acquiring lock "refresh_cache-a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:30:17 user nova-compute[71482]: DEBUG nova.network.neutron [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Updating instance_info_cache with network_info: [{"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:30:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Releasing lock "refresh_cache-a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:30:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Instance network_info: |[{"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:30:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] Acquired lock "refresh_cache-a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:30:17 user nova-compute[71482]: DEBUG nova.network.neutron [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Refreshing network info cache for port ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:30:17 user nova-compute[71482]: DEBUG nova.network.neutron [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Updated VIF entry in instance network info cache for port ba9d50c6-6711-4652-bb0a-7a020a9b68e3. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:30:17 user nova-compute[71482]: DEBUG nova.network.neutron [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Updating instance_info_cache with network_info: [{"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:30:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b54df59b-8060-4082-b26c-fac314c078ce req-09f6f604-fa4a-4c31-8568-8520035c43ce service nova] Releasing lock "refresh_cache-a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:30:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG os_brick.utils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab015ed1-978d-4eaa-86d1-a88a043c82e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cee21f-9328-409d-8e49-44b2e7f91e10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f95f4e9-396b-493b-a76b-3bdc868fe398]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e27df-1bd8-4d52-b726-8761b1dbb4b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:30:21 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:30:21 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efa5419-e2f8-4d4a-bfca-e84152bf2b7a]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG os_brick.utils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:30:21 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Updating existing volume attachment record: 31f582d8-4a56-4b03-bb34-443773efcf69 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:22 user nova-compute[71482]: INFO nova.compute.manager [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Terminating instance
Apr 12 09:30:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-unplugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] No waiting events found dispatching network-vif-unplugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-60a9f704-4c2f-41d6-bfa3-5b25459a72f4 req-2d7fcc51-21ff-45d4-b004-888ef08b8ca6 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-unplugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:23 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Instance destroyed successfully.
Apr 12 09:30:23 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lazy-loading 'resources' on Instance uuid 8a52d45c-9ce4-4e4f-973a-fffce9f85bef {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:24:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-368249722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-368249722',id=29,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIM5L2YPZ2KVlhG6oFOZGGwTxHh7VmuiAaOSH0We/vpq8fOiO1mNYzg6+tMndipazXRpul18uCeRgGch/My5l++MyiqK2qEK0kNajHsUhulUGdS/XiM9WXRLjaM3kVzoxA==',key_name='tempest-keypair-202654117',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:28:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ebfa64bb5194b859821a77de6805d2d',ramdisk_id='',reservation_id='r-i7mje20m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-72439030',owner_user_name='tempest-AttachVolumeShelveTestJSON-72439030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:28:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d76daece06a943668e6c1c3c2c57ebaa',uuid=8a52d45c-9ce4-4e4f-973a-fffce9f85bef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converting VIF {"id": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "address": "fa:16:3e:27:9c:2b", "network": {"id": "1da53f15-1745-4e97-beac-302695973f1f", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1214092776-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ebfa64bb5194b859821a77de6805d2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c0316e9-60", "ovs_interfaceid": "2c0316e9-6065-4c8c-8e7d-8d02f54d0083", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG os_vif [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c0316e9-60, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:30:23 user nova-compute[71482]: INFO os_vif [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:9c:2b,bridge_name='br-int',has_traffic_filtering=True,id=2c0316e9-6065-4c8c-8e7d-8d02f54d0083,network=Network(1da53f15-1745-4e97-beac-302695973f1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c0316e9-60')
Apr 12 09:30:23 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Deleting instance files /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef_del
Apr 12 09:30:23 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Deletion of /opt/stack/data/nova/instances/8a52d45c-9ce4-4e4f-973a-fffce9f85bef_del complete
Apr 12 09:30:23 user nova-compute[71482]: INFO nova.compute.manager [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 09:30:23 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:30:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:30:24 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Took 0.77 seconds to deallocate network for instance.
Apr 12 09:30:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-874d9349-da0b-4a15-99ff-fc7e51e70f6b req-0d4e1b7f-e567-4a9e-b2d2-ac24b3c528c1 service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-deleted-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:24 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Deleted allocations for instance 8a52d45c-9ce4-4e4f-973a-fffce9f85bef
Apr 12 09:30:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e802555e-bf50-4a23-9822-f688d1ec570d tempest-AttachVolumeShelveTestJSON-72439030 tempest-AttachVolumeShelveTestJSON-72439030-project-member] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.038s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] Acquiring lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] Lock "8a52d45c-9ce4-4e4f-973a-fffce9f85bef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] No waiting events found dispatching network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:24 user nova-compute[71482]: WARNING nova.compute.manager [req-46b3f568-fb38-414d-a46c-09e4952c98bc req-01d1586a-78b8-4404-9046-330d0940a4ba service nova] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Received unexpected event network-vif-plugged-2c0316e9-6065-4c8c-8e7d-8d02f54d0083 for instance with vm_state deleted and task_state None.
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:30:25 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Creating image(s)
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Ensure instance console log exists: /opt/stack/data/nova/instances/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Start _get_guest_xml network_info=[{"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '31f582d8-4a56-4b03-bb34-443773efcf69', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlXfsLKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a1d6aa01-e33d-4081-8c83-fb074b9dfaa7', 'attached_at': '', 'detached_at': '', 'volume_id': '49213ee8-fc0a-46f1-be6c-fd3b2823f42a', 'serial': '49213ee8-fc0a-46f1-be6c-fd3b2823f42a'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:30:25 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:30:25 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlXfsLKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:30:25 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:30:25 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:30:25 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df3ff89-c457-4b10-a9c1-9c9615230d13]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:30:25 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc461bdf-edee-4465-9840-935968fb4e82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a] added
Apr 12 09:30:25 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea84a0a-9701-42a7-a691-e2b194f656c5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad474ee-1e3c-4171-abb7-39724036434e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vlXfsLKr {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vlXfsLKr" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd45bf-5646-4c00-93ea-f1db59ecb4be]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vlXfsLKr'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdf7729-df7b-4ed0-9d92-fda909485ec4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf228363-bcae-4445-91b3-99dcade89f49]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:30:25 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:30:25 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:30:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1331179-8ee5-4503-adba-8473f6db2777]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a, portal: 172.16.0.220,3260]
Apr 12 09:30:26 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a, portal: 172.16.0.220,3260] successful.
Apr 12 09:30:26 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bd7a56-f9a8-48a6-82fb-9710ce0dc129]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f877f878-41a1-43ab-8387-7a2360263e28]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:30:26 user nova-compute[71482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a (non-flash)
Apr 12 09:30:26 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:30:26 user nova-compute[71482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a (non-flash)
Apr 12 09:30:26 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c12c3c-37fc-4c9e-8d2f-f3988de5b39a]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:30:26 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlXfsLKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23965353637326532', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965353637326532', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-910217585',display_name='tempest-TestVolumeBootPattern-server-910217585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-910217585',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-mmyxblzt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:30:15Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=a1d6aa01-e33d-4081-8c83-fb074b9dfaa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=ba9d50c6-6711-4652-bb0a-7a020a9b68e3,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9d50c6-67') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.objects.instance [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'pci_devices' on Instance uuid a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:30:27 user nova-compute[71482]:   <uuid>a1d6aa01-e33d-4081-8c83-fb074b9dfaa7</uuid>
Apr 12 09:30:27 user nova-compute[71482]:   <name>instance-00000023</name>
Apr 12 09:30:27 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:30:27 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:30:27 user nova-compute[71482]:   <metadata>
Apr 12 09:30:27 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:30:27 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:30:27 user nova-compute[71482]:       <nova:name>tempest-TestVolumeBootPattern-server-910217585</nova:name>
Apr 12 09:30:27 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:30:25</nova:creationTime>
Apr 12 09:30:27 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:30:27 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:30:27 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:30:27 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:30:27 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:30:27 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:30:27 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:30:27 user nova-compute[71482]:       <nova:owner>
Apr 12 09:30:27 user nova-compute[71482]:         <nova:user uuid="4d3fba65a6ff4e73addd3ec6cdbb08cf">tempest-TestVolumeBootPattern-757175647-project-member</nova:user>
Apr 12 09:30:27 user nova-compute[71482]:         <nova:project uuid="1a0437bfee4545949707443636e07b80">tempest-TestVolumeBootPattern-757175647</nova:project>
Apr 12 09:30:27 user nova-compute[71482]:       </nova:owner>
Apr 12 09:30:27 user nova-compute[71482]:       <nova:ports>
Apr 12 09:30:27 user nova-compute[71482]:         <nova:port uuid="ba9d50c6-6711-4652-bb0a-7a020a9b68e3">
Apr 12 09:30:27 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 09:30:27 user nova-compute[71482]:         </nova:port>
Apr 12 09:30:27 user nova-compute[71482]:       </nova:ports>
Apr 12 09:30:27 user nova-compute[71482]:     </nova:instance>
Apr 12 09:30:27 user nova-compute[71482]:   </metadata>
Apr 12 09:30:27 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:30:27 user nova-compute[71482]:     <system>
Apr 12 09:30:27 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:30:27 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:30:27 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:30:27 user nova-compute[71482]:       <entry name="serial">a1d6aa01-e33d-4081-8c83-fb074b9dfaa7</entry>
Apr 12 09:30:27 user nova-compute[71482]:       <entry name="uuid">a1d6aa01-e33d-4081-8c83-fb074b9dfaa7</entry>
Apr 12 09:30:27 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:30:27 user nova-compute[71482]:     </system>
Apr 12 09:30:27 user nova-compute[71482]:   </sysinfo>
Apr 12 09:30:27 user nova-compute[71482]:   <os>
Apr 12 09:30:27 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:30:27 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:30:27 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:30:27 user nova-compute[71482]:   </os>
Apr 12 09:30:27 user nova-compute[71482]:   <features>
Apr 12 09:30:27 user nova-compute[71482]:     <acpi/>
Apr 12 09:30:27 user nova-compute[71482]:     <apic/>
Apr 12 09:30:27 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:30:27 user nova-compute[71482]:   </features>
Apr 12 09:30:27 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:30:27 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:30:27 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:30:27 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:30:27 user nova-compute[71482]:   </clock>
Apr 12 09:30:27 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:30:27 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:30:27 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:30:27 user nova-compute[71482]:   </cpu>
Apr 12 09:30:27 user nova-compute[71482]:   <devices>
Apr 12 09:30:27 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:30:27 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:30:27 user nova-compute[71482]:       <source dev="/dev/sdc"/>
Apr 12 09:30:27 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:30:27 user nova-compute[71482]:       <serial>49213ee8-fc0a-46f1-be6c-fd3b2823f42a</serial>
Apr 12 09:30:27 user nova-compute[71482]:     </disk>
Apr 12 09:30:27 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:30:27 user nova-compute[71482]:       <mac address="fa:16:3e:16:b4:54"/>
Apr 12 09:30:27 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:30:27 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:30:27 user nova-compute[71482]:       <target dev="tapba9d50c6-67"/>
Apr 12 09:30:27 user nova-compute[71482]:     </interface>
Apr 12 09:30:27 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:30:27 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7/console.log" append="off"/>
Apr 12 09:30:27 user nova-compute[71482]:     </serial>
Apr 12 09:30:27 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:30:27 user nova-compute[71482]:     <video>
Apr 12 09:30:27 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:30:27 user nova-compute[71482]:     </video>
Apr 12 09:30:27 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:30:27 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:30:27 user nova-compute[71482]:     </rng>
Apr 12 09:30:27 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:30:27 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:30:27 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:30:27 user nova-compute[71482]:     </memballoon>
Apr 12 09:30:27 user nova-compute[71482]:   </devices>
Apr 12 09:30:27 user nova-compute[71482]: </domain>
Apr 12 09:30:27 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-910217585',display_name='tempest-TestVolumeBootPattern-server-910217585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-910217585',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-mmyxblzt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:30:15Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=a1d6aa01-e33d-4081-8c83-fb074b9dfaa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=ba9d50c6-6711-4652-bb0a-7a020a9b68e3,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9d50c6-67') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG os_vif [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=ba9d50c6-6711-4652-bb0a-7a020a9b68e3,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9d50c6-67') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba9d50c6-67, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba9d50c6-67, col_values=(('external_ids', {'iface-id': 'ba9d50c6-6711-4652-bb0a-7a020a9b68e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:b4:54', 'vm-uuid': 'a1d6aa01-e33d-4081-8c83-fb074b9dfaa7'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:27 user nova-compute[71482]: INFO os_vif [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=ba9d50c6-6711-4652-bb0a-7a020a9b68e3,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9d50c6-67')
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:30:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No VIF found with MAC fa:16:3e:16:b4:54, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:30:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received event network-vif-plugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] Acquiring lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] No waiting events found dispatching network-vif-plugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:28 user nova-compute[71482]: WARNING nova.compute.manager [req-a3a4d84a-c444-4cf8-98b4-c17d49d9a3ff req-5d7482af-76f1-44ce-a53d-c2953f54f7be service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received unexpected event network-vif-plugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance with vm_state building and task_state spawning.
Apr 12 09:30:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291830.6043167, a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:30:30 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] VM Resumed (Lifecycle Event)
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:30:30 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Instance spawned successfully.
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:30:30 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291830.6055346, a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:30:30 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] VM Started (Lifecycle Event)
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:30:30 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:30:30 user nova-compute[71482]: INFO nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Took 5.00 seconds to spawn the instance on the hypervisor.
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received event network-vif-plugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] Acquiring lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] No waiting events found dispatching network-vif-plugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:30 user nova-compute[71482]: WARNING nova.compute.manager [req-f355c334-e33e-4413-910f-cba1051d62ae req-814280b7-78ea-4a04-979c-ffda044466bf service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received unexpected event network-vif-plugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance with vm_state building and task_state spawning.
Apr 12 09:30:30 user nova-compute[71482]: INFO nova.compute.manager [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Took 16.78 seconds to build instance.
Apr 12 09:30:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-243f5c00-4fff-4ed2-9fb8-8442311c7be5 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.892s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:35 user nova-compute[71482]: INFO nova.compute.manager [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Terminating instance
Apr 12 09:30:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "57fc5db7-8577-4a55-a511-d9f25db0a43c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:36 user nova-compute[71482]: INFO nova.compute.manager [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Terminating instance
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-unplugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] No waiting events found dispatching network-vif-unplugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-c30f8b5b-6aba-4343-a472-aaafd98a2cd6 req-7add399c-0c57-4108-a840-f3844c11548c service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-unplugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received event network-vif-unplugged-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] Acquiring lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] No waiting events found dispatching network-vif-unplugged-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-7e5909ad-fe58-4ebc-8b2d-97e1a4e1a384 req-bd254a5a-730e-4cf2-b53b-c221f5d8086f service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received event network-vif-unplugged-10aaf934-db80-40bb-9b6c-464151693b9c for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Instance destroyed successfully.
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lazy-loading 'resources' on Instance uuid 57fc5db7-8577-4a55-a511-d9f25db0a43c {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:30:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Instance destroyed successfully.
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lazy-loading 'resources' on Instance uuid a8a87d28-e580-44f4-b257-ba4b4d7fa223 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:28:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2004437417',display_name='tempest-ServersNegativeTestJSON-server-2004437417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2004437417',id=34,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:28:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcea1b997ee6450dbf603305d2812f7f',ramdisk_id='',reservation_id='r-tpf8igce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1848567648',owner_user_name='tempest-ServersNegativeTestJSON-1848567648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:28:52Z,user_data=None,user_id='741e227a2cc7425d8b171c2a04989191',uuid=57fc5db7-8577-4a55-a511-d9f25db0a43c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converting VIF {"id": "10aaf934-db80-40bb-9b6c-464151693b9c", "address": "fa:16:3e:41:bf:65", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10aaf934-db", "ovs_interfaceid": "10aaf934-db80-40bb-9b6c-464151693b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:bf:65,bridge_name='br-int',has_traffic_filtering=True,id=10aaf934-db80-40bb-9b6c-464151693b9c,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10aaf934-db') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG os_vif [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:bf:65,bridge_name='br-int',has_traffic_filtering=True,id=10aaf934-db80-40bb-9b6c-464151693b9c,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10aaf934-db') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:27:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2062565541',display_name='tempest-AttachVolumeNegativeTest-server-2062565541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2062565541',id=33,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmqL/RA2rC1kBm3Ff5KrAftAjrvhWNZ/OQ5TDfV9dAC2Ccj/MoRUsFjeZcGQJBlDG6A617ip4RQTAT5Ukp1cISoHXEaXM5g0tGPnH9lEp7FMv/jSMqDy+I7uQrZBLhWyg==',key_name='tempest-keypair-362915146',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:27:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37b4beaf457f4120bcbcd2b033d5c3db',ramdisk_id='',reservation_id='r-2p1cxh5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-395431601',owner_user_name='tempest-AttachVolumeNegativeTest-395431601-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:27:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f91fed06f9547d29125f38fe2d47221',uuid=a8a87d28-e580-44f4-b257-ba4b4d7fa223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converting VIF {"id": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "address": "fa:16:3e:f1:d8:bc", "network": {"id": "9900741d-c340-4245-aeef-59065c45b165", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-309072912-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37b4beaf457f4120bcbcd2b033d5c3db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3d58c2b-2a", "ovs_interfaceid": "f3d58c2b-2ae0-4211-8ab8-034c875fd516", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3d58c2b-2ae0-4211-8ab8-034c875fd516,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d58c2b-2a') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG os_vif [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3d58c2b-2ae0-4211-8ab8-034c875fd516,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d58c2b-2a') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10aaf934-db, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3d58c2b-2a, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:30:36 user nova-compute[71482]: INFO os_vif [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:bf:65,bridge_name='br-int',has_traffic_filtering=True,id=10aaf934-db80-40bb-9b6c-464151693b9c,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10aaf934-db')
Apr 12 09:30:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Deleting instance files /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c_del
Apr 12 09:30:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Deletion of /opt/stack/data/nova/instances/57fc5db7-8577-4a55-a511-d9f25db0a43c_del complete
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:30:36 user nova-compute[71482]: INFO os_vif [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:d8:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3d58c2b-2ae0-4211-8ab8-034c875fd516,network=Network(9900741d-c340-4245-aeef-59065c45b165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3d58c2b-2a')
Apr 12 09:30:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Deleting instance files /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223_del
Apr 12 09:30:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Deletion of /opt/stack/data/nova/instances/a8a87d28-e580-44f4-b257-ba4b4d7fa223_del complete
Apr 12 09:30:37 user nova-compute[71482]: INFO nova.compute.manager [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Took 1.10 seconds to destroy the instance on the hypervisor.
Apr 12 09:30:37 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:30:37 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:30:37 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:30:37 user nova-compute[71482]: INFO nova.compute.manager [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Took 1.05 seconds to destroy the instance on the hypervisor.
Apr 12 09:30:37 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:30:37 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:30:37 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:30:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:30:38 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Took 0.95 seconds to deallocate network for instance.
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-f10eafc8-8341-4cbc-805e-d88fbadbe2f2 req-cc97bcb2-77ad-46fe-ade0-5f316f2afa15 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received event network-vif-deleted-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:30:38 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Took 1.13 seconds to deallocate network for instance.
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291823.210314, 8a52d45c-9ce4-4e4f-973a-fffce9f85bef => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:30:38 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] VM Stopped (Lifecycle Event)
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [None req-84e3e05e-df45-4933-83aa-b5c33f466b34 None None] [instance: 8a52d45c-9ce4-4e4f-973a-fffce9f85bef] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.078s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:38 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Deleted allocations for instance 57fc5db7-8577-4a55-a511-d9f25db0a43c
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] No waiting events found dispatching network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:38 user nova-compute[71482]: WARNING nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received unexpected event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance with vm_state deleted and task_state None.
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] No waiting events found dispatching network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:38 user nova-compute[71482]: WARNING nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received unexpected event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance with vm_state deleted and task_state None.
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] No waiting events found dispatching network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:38 user nova-compute[71482]: WARNING nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received unexpected event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance with vm_state deleted and task_state None.
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-unplugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] No waiting events found dispatching network-vif-unplugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:38 user nova-compute[71482]: WARNING nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received unexpected event network-vif-unplugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance with vm_state deleted and task_state None.
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Acquiring lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] No waiting events found dispatching network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:38 user nova-compute[71482]: WARNING nova.compute.manager [req-a0d2c50b-74d4-44d2-af4d-d5989c4eea2e req-b5c71fe3-9ba8-4462-a50c-8c23238db4b5 service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received unexpected event network-vif-plugged-f3d58c2b-2ae0-4211-8ab8-034c875fd516 for instance with vm_state deleted and task_state None.
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9122523b-115c-4b7a-b01a-18de60c4e73c tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.453s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received event network-vif-plugged-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] Acquiring lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] Lock "57fc5db7-8577-4a55-a511-d9f25db0a43c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] No waiting events found dispatching network-vif-plugged-10aaf934-db80-40bb-9b6c-464151693b9c {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:30:38 user nova-compute[71482]: WARNING nova.compute.manager [req-1cb01193-8602-423f-96c6-df6f9d6cfe5c req-6129e3f9-c985-4990-b4c0-ccd0e6255186 service nova] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Received unexpected event network-vif-plugged-10aaf934-db80-40bb-9b6c-464151693b9c for instance with vm_state deleted and task_state None.
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Deleted allocations for instance a8a87d28-e580-44f4-b257-ba4b4d7fa223
Apr 12 09:30:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-62896471-99b4-49d5-a52e-679296380b05 tempest-AttachVolumeNegativeTest-395431601 tempest-AttachVolumeNegativeTest-395431601-project-member] Lock "a8a87d28-e580-44f4-b257-ba4b4d7fa223" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.743s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:30:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-f89aecce-4b18-44f6-8f38-b22013205ae2 req-c048cfc1-c1d2-4e9c-968a-62d524bd8f6f service nova] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Received event network-vif-deleted-f3d58c2b-2ae0-4211-8ab8-034c875fd516 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:30:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:43 user nova-compute[71482]: INFO nova.compute.manager [None req-afcbd675-d814-41c7-959f-54c81e3a77cf tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Get console output
Apr 12 09:30:43 user nova-compute[71482]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 12 09:30:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:51 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291836.9004765, 57fc5db7-8577-4a55-a511-d9f25db0a43c => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:30:51 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] VM Stopped (Lifecycle Event)
Apr 12 09:30:51 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291836.9132607, a8a87d28-e580-44f4-b257-ba4b4d7fa223 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:30:51 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] VM Stopped (Lifecycle Event)
Apr 12 09:30:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-83c4951f-e018-4781-ad71-4aed856b019c None None] [instance: 57fc5db7-8577-4a55-a511-d9f25db0a43c] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:30:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-abe67845-21d6-4d19-b6d9-dd60f81387cf None None] [instance: a8a87d28-e580-44f4-b257-ba4b4d7fa223] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:30:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updating instance_info_cache with network_info: [{"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:30:59 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:30:59 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:02 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:31:04 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:31:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:31:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:31:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:31:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:31:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:31:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:31:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:31:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:31:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:31:16 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:31:16 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8458MB free_disk=26.338714599609375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1088MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:31:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:31:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:31:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:31:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:31:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:31:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:31:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:31:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:31:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:31:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:31:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:31:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:31:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:31:43 user nova-compute[71482]: INFO nova.compute.manager [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Terminating instance
Apr 12 09:31:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:31:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-unplugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] No waiting events found dispatching network-vif-unplugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG nova.compute.manager [req-d42760ab-110e-4592-9c96-5ea6a1f38ae9 req-ff15afb6-de75-4df9-9c5b-b4fb340c37f4 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-unplugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Instance destroyed successfully.
Apr 12 09:31:44 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'resources' on Instance uuid 6720b589-6dc8-460a-bdc2-52b9b1cd77fb {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:25:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-310903129',display_name='tempest-ServerActionsTestJSON-server-310903129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-310903129',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:27:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-0yzal2xx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:28:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=6720b589-6dc8-460a-bdc2-52b9b1cd77fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "address": "fa:16:3e:b5:91:cc", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6dffcd5-fc", "ovs_interfaceid": "d6dffcd5-fc3c-47e6-a72e-22d72ab3a406", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_vif [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6dffcd5-fc, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:31:44 user nova-compute[71482]: INFO os_vif [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:91:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6dffcd5-fc3c-47e6-a72e-22d72ab3a406,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6dffcd5-fc')
Apr 12 09:31:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmQZiMUS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:31:44 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7380e1-13fd-44a1-99f4-d99727009dcc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:31:44 user nova-compute[71482]: No targets found.
Apr 12 09:31:44 user nova-compute[71482]: iSNS:
Apr 12 09:31:44 user nova-compute[71482]: No targets found.
Apr 12 09:31:44 user nova-compute[71482]: STATIC:
Apr 12 09:31:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2
Apr 12 09:31:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:31:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:31:44 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a
Apr 12 09:31:44 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:31:44 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:31:44 user nova-compute[71482]: FIRMWARE:
Apr 12 09:31:44 user nova-compute[71482]: No targets found.
Apr 12 09:31:44 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:31:44 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:31:44 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbb148a-0874-429a-a2d3-b7b7f50bca34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dd8710-c73d-42c8-aa8f-cf7411900926]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:31:44 user nova-compute[71482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a (non-flash)
Apr 12 09:31:44 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 (non-flash)
Apr 12 09:31:44 user nova-compute[71482]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a (non-flash)
Apr 12 09:31:44 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f930872a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a840e4a3-8775-4c2c-aa90-7af66271ac1e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[53667de9-fa75-4db2-ad99-8bc8125277f4]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1363129d-ffff-49f7-b8fe-b6edc83349a8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1314e0cb-88ae-4d69-b70e-489d902af494]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6682a2-4a85-444d-b995-d90f8e9e40b9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a127043c-74b7-45fd-9f5d-c2168bd8170c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260]
Apr 12 09:31:44 user nova-compute[71482]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2, portal: 172.16.0.220,3260] successful.
Apr 12 09:31:44 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da73130e-1f1c-40e7-9961-d5b661f114a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b35d32-6b75-43c3-b31e-928882a4723a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] <== disconnect_volume: return (305ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:31:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:31:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Deleting instance files /opt/stack/data/nova/instances/6720b589-6dc8-460a-bdc2-52b9b1cd77fb_del
Apr 12 09:31:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Deletion of /opt/stack/data/nova/instances/6720b589-6dc8-460a-bdc2-52b9b1cd77fb_del complete
Apr 12 09:31:45 user nova-compute[71482]: INFO nova.compute.manager [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 12 09:31:45 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:31:45 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:31:45 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:31:46 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:31:46 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Took 1.14 seconds to deallocate network for instance.
Apr 12 09:31:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:31:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] Acquiring lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:31:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:31:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:31:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] No waiting events found dispatching network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:31:46 user nova-compute[71482]: WARNING nova.compute.manager [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received unexpected event network-vif-plugged-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 for instance with vm_state active and task_state deleting.
Apr 12 09:31:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-b189e4c9-0c92-461b-bd45-6d2c45e51356 req-4d236e80-fcf6-44a7-9c1d-358f9c13d1f7 service nova] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Received event network-vif-deleted-d6dffcd5-fc3c-47e6-a72e-22d72ab3a406 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:31:47 user nova-compute[71482]: INFO nova.compute.manager [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Took 0.97 seconds to detach 1 volumes for instance.
Apr 12 09:31:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Deleting volume: da73130e-1f1c-40e7-9961-d5b661f114a2 {{(pid=71482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 09:31:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:31:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:31:47 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:31:47 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:31:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:31:47 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Deleted allocations for instance 6720b589-6dc8-460a-bdc2-52b9b1cd77fb
Apr 12 09:31:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8f9d68a8-ce27-4b4f-ad50-091a4f90ca8e tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "6720b589-6dc8-460a-bdc2-52b9b1cd77fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.742s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:31:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:31:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:31:59 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:59 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:31:59 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:31:59 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:59 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:31:59 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291904.5883055, 6720b589-6dc8-460a-bdc2-52b9b1cd77fb => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:31:59 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] VM Stopped (Lifecycle Event)
Apr 12 09:31:59 user nova-compute[71482]: DEBUG nova.compute.manager [None req-11c7691c-ab53-495e-918e-ec949a447146 None None] [instance: 6720b589-6dc8-460a-bdc2-52b9b1cd77fb] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:31:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:32:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:32:02 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:32:02 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:04 user nova-compute[71482]: INFO nova.compute.manager [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Terminating instance
Apr 12 09:32:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:32:05 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Instance destroyed successfully.
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.objects.instance [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'resources' on Instance uuid a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-910217585',display_name='tempest-TestVolumeBootPattern-server-910217585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-910217585',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:30:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-mmyxblzt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:30:31Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=a1d6aa01-e33d-4081-8c83-fb074b9dfaa7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "address": "fa:16:3e:16:b4:54", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba9d50c6-67", "ovs_interfaceid": "ba9d50c6-6711-4652-bb0a-7a020a9b68e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=ba9d50c6-6711-4652-bb0a-7a020a9b68e3,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9d50c6-67') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_vif [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=ba9d50c6-6711-4652-bb0a-7a020a9b68e3,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9d50c6-67') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba9d50c6-67, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received event network-vif-unplugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] Acquiring lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] No waiting events found dispatching network-vif-unplugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-42f8d35e-bdea-443e-b6e8-631b48724ef0 req-dca3b1b8-e89b-40a7-a209-06ff2b8fad09 service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received event network-vif-unplugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:32:05 user nova-compute[71482]: INFO os_vif [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:b4:54,bridge_name='br-int',has_traffic_filtering=True,id=ba9d50c6-6711-4652-bb0a-7a020a9b68e3,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba9d50c6-67')
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vlXfsLKr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:32:05 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e532632-2da5-436b-a209-c237ef4a7843]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:32:05 user nova-compute[71482]: No targets found.
Apr 12 09:32:05 user nova-compute[71482]: iSNS:
Apr 12 09:32:05 user nova-compute[71482]: No targets found.
Apr 12 09:32:05 user nova-compute[71482]: STATIC:
Apr 12 09:32:05 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a
Apr 12 09:32:05 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:32:05 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:32:05 user nova-compute[71482]: FIRMWARE:
Apr 12 09:32:05 user nova-compute[71482]: No targets found.
Apr 12 09:32:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:32:05 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:32:05 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c289f8f4-1609-425d-a675-249c3c8ed8a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89d867a-0e30-49db-97c2-82c294e198fd]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a (non-flash)
Apr 12 09:32:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a (non-flash)
Apr 12 09:32:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c1de5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57c95c0-26a9-460c-ac68-fab71d0db54b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f98458-c86f-4b44-b61f-9a4b1f9a2489]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d2197c-f84c-45e8-a09b-616d22b4afcd]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5065790b-3b2b-41e1-87a4-c3e320caccd3]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO53789e13-9e5672e22f75fe29', '/dev/disk/by-id/scsi-23965353637326532', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_53789e13') {{(pid=82392) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73466dd-e0b4-4a3d-ad7c-78560f306ede]: (4, None) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[673e9a20-03a6-4bfc-b9e2-70c5a4abe815]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ab7d34-9fce-496f-9e88-b8b2c5a1d267]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a, portal: 172.16.0.220,3260]
Apr 12 09:32:05 user nova-compute[71482]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a, portal: 172.16.0.220,3260] successful.
Apr 12 09:32:05 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:49213ee8-fc0a-46f1-be6c-fd3b2823f42a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b29ec4-708f-453b-969b-e121995ab2d4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== disconnect_volume: return (325ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:32:05 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Deleting instance files /opt/stack/data/nova/instances/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7_del
Apr 12 09:32:05 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Deletion of /opt/stack/data/nova/instances/a1d6aa01-e33d-4081-8c83-fb074b9dfaa7_del complete
Apr 12 09:32:05 user nova-compute[71482]: INFO nova.compute.manager [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 12 09:32:05 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:32:05 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:32:06 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:32:06 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Took 0.48 seconds to deallocate network for instance.
Apr 12 09:32:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-516868ac-c7b6-4cc9-8208-ef75bec9afe7 req-62f3a1df-ed09-4488-bedb-a7873aa22c03 service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received event network-vif-deleted-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:32:06 user nova-compute[71482]: INFO nova.compute.manager [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Took 0.83 seconds to detach 1 volumes for instance.
Apr 12 09:32:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Deleting volume: 49213ee8-fc0a-46f1-be6c-fd3b2823f42a {{(pid=71482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 09:32:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:07 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:32:07 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:32:07 user nova-compute[71482]: DEBUG nova.compute.manager [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received event network-vif-plugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:32:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] Acquiring lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:07 user nova-compute[71482]: DEBUG nova.compute.manager [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] No waiting events found dispatching network-vif-plugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:32:07 user nova-compute[71482]: WARNING nova.compute.manager [req-e02ad342-f579-4f27-86ca-4df7b5ead559 req-c7882504-5735-4461-b745-b99e9a2220af service nova] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Received unexpected event network-vif-plugged-ba9d50c6-6711-4652-bb0a-7a020a9b68e3 for instance with vm_state deleted and task_state None.
Apr 12 09:32:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.206s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:07 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Deleted allocations for instance a1d6aa01-e33d-4081-8c83-fb074b9dfaa7
Apr 12 09:32:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-42feac71-8c30-4dc7-8a6d-9d81ec206fe4 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a1d6aa01-e33d-4081-8c83-fb074b9dfaa7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.984s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:32:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:32:16 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:32:16 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:32:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=26.316787719726562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:32:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:20 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291925.1535363, a1d6aa01-e33d-4081-8c83-fb074b9dfaa7 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:32:20 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] VM Stopped (Lifecycle Event)
Apr 12 09:32:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-835f6055-72f8-4e55-8d4f-571654a7a7a2 None None] [instance: a1d6aa01-e33d-4081-8c83-fb074b9dfaa7] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:32:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:32:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "d2be3178-85b4-4012-a7d0-2d8543a65a42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:34 user nova-compute[71482]: INFO nova.compute.manager [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Terminating instance
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received event network-vif-unplugged-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] Acquiring lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] No waiting events found dispatching network-vif-unplugged-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-b25f3953-5607-418e-8ce8-f3cc14dd63eb req-cbd5f7fc-1132-429d-8c21-c51a6695b7d6 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received event network-vif-unplugged-0ea8781f-860c-4135-8264-ad52a792fa55 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:32:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Instance destroyed successfully.
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lazy-loading 'resources' on Instance uuid d2be3178-85b4-4012-a7d0-2d8543a65a42 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:23:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-733421240',display_name='tempest-ServerActionsTestJSON-server-733421240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-733421240',id=26,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv8zpotM8asK/6YKg7H1VPIxrXcPYQz1Doo/rATIAd2IFwGsBPis403AeuLIXmo9Mne5zRVL1yf/GL5t3R6PHKTXkisjh2mVQxFvBRq0UFnRJ6WY7eYa09HigFOXPwB3w==',key_name='tempest-keypair-184491568',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:23:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='20b8c89c46bb460f9f94be9426a22bb8',ramdisk_id='',reservation_id='r-wv318c4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1142062861',owner_user_name='tempest-ServerActionsTestJSON-1142062861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:23:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='375db5b9a80244d3878822049230ba47',uuid=d2be3178-85b4-4012-a7d0-2d8543a65a42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converting VIF {"id": "0ea8781f-860c-4135-8264-ad52a792fa55", "address": "fa:16:3e:b4:fa:ab", "network": {"id": "ba002f9e-601a-4b3a-b386-afb97d19b8c4", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-706330370-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "20b8c89c46bb460f9f94be9426a22bb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ea8781f-86", "ovs_interfaceid": "0ea8781f-860c-4135-8264-ad52a792fa55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:fa:ab,bridge_name='br-int',has_traffic_filtering=True,id=0ea8781f-860c-4135-8264-ad52a792fa55,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea8781f-86') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG os_vif [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:fa:ab,bridge_name='br-int',has_traffic_filtering=True,id=0ea8781f-860c-4135-8264-ad52a792fa55,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea8781f-86') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ea8781f-86, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:32:34 user nova-compute[71482]: INFO os_vif [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:fa:ab,bridge_name='br-int',has_traffic_filtering=True,id=0ea8781f-860c-4135-8264-ad52a792fa55,network=Network(ba002f9e-601a-4b3a-b386-afb97d19b8c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ea8781f-86')
Apr 12 09:32:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Deleting instance files /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42_del
Apr 12 09:32:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Deletion of /opt/stack/data/nova/instances/d2be3178-85b4-4012-a7d0-2d8543a65a42_del complete
Apr 12 09:32:34 user nova-compute[71482]: INFO nova.compute.manager [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Took 0.67 seconds to destroy the instance on the hypervisor.
Apr 12 09:32:34 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:32:34 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:32:35 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:32:35 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Took 0.46 seconds to deallocate network for instance.
Apr 12 09:32:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received event network-vif-deleted-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:32:35 user nova-compute[71482]: INFO nova.compute.manager [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Neutron deleted interface 0ea8781f-860c-4135-8264-ad52a792fa55; detaching it from the instance and deleting it from the info cache
Apr 12 09:32:35 user nova-compute[71482]: DEBUG nova.network.neutron [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:32:35 user nova-compute[71482]: DEBUG nova.compute.manager [req-a26fc861-e022-4159-984c-525160d182ea req-278d4cea-3fb3-477d-b912-b3f3852383b1 service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Detach interface failed, port_id=0ea8781f-860c-4135-8264-ad52a792fa55, reason: Instance d2be3178-85b4-4012-a7d0-2d8543a65a42 could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:32:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:35 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:32:35 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:32:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:35 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Deleted allocations for instance d2be3178-85b4-4012-a7d0-2d8543a65a42
Apr 12 09:32:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a77d5ebc-e276-49a5-a9bf-f57985c06ce9 tempest-ServerActionsTestJSON-1142062861 tempest-ServerActionsTestJSON-1142062861-project-member] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.462s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received event network-vif-plugged-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:32:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] Acquiring lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:32:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:32:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] Lock "d2be3178-85b4-4012-a7d0-2d8543a65a42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:32:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] No waiting events found dispatching network-vif-plugged-0ea8781f-860c-4135-8264-ad52a792fa55 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:32:36 user nova-compute[71482]: WARNING nova.compute.manager [req-a48d9097-49ef-4106-b74a-f3c9906ae522 req-7779adc3-9ee6-4938-bd9e-32dafed6ffcf service nova] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Received unexpected event network-vif-plugged-0ea8781f-860c-4135-8264-ad52a792fa55 for instance with vm_state deleted and task_state None.
Apr 12 09:32:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:49 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681291954.823742, d2be3178-85b4-4012-a7d0-2d8543a65a42 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:32:49 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] VM Stopped (Lifecycle Event)
Apr 12 09:32:49 user nova-compute[71482]: DEBUG nova.compute.manager [None req-6724bb8d-473f-43c2-a18f-4dca8b16b57f None None] [instance: d2be3178-85b4-4012-a7d0-2d8543a65a42] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:32:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:32:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:32:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:33:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:33:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:33:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:33:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:33:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:33:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid 16ed5717-a2c5-469a-b1c8-2577b4debc2f {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:33:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updating instance_info_cache with network_info: [{"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:33:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:33:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:33:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "cd463b2a-f10b-424a-b199-c8db4aa486bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:33:03 user nova-compute[71482]: INFO nova.compute.claims [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Claim successful on node user
Apr 12 09:33:03 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:33:03 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:33:03 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:33:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG nova.policy [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:33:04 user nova-compute[71482]: INFO nova.virt.block_device [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Booting with volume 8004e131-a0ca-4d62-9c3b-2d379228886e at /dev/vda
Apr 12 09:33:04 user nova-compute[71482]: DEBUG os_brick.utils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35cdcb7-7523-4bd4-9c7b-cf27437b6dcc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4980e891-d0ff-4b85-8ecd-a84bfc5f3b1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eca5fb-7337-4ae7-825a-1a329286541a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdedf10e-038a-4702-87e4-ee637f301d9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:33:04 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:33:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e3c5e-bb6a-4477-bce0-f601f0e6021f]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG os_brick.utils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Updating existing volume attachment record: 96fcbb26-83c7-41fd-9c78-bc5696fd6ac0 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Successfully created port: ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:33:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Successfully updated port: ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquired lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received event network-changed-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Refreshing instance network info cache due to event network-changed-ccf2d9f7-9747-4452-9248-874c2b8b23cf. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] Acquiring lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Updating instance_info_cache with network_info: [{"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Releasing lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Instance network_info: |[{"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] Acquired lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:33:05 user nova-compute[71482]: DEBUG nova.network.neutron [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Refreshing network info cache for port ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:33:06 user nova-compute[71482]: DEBUG nova.network.neutron [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Updated VIF entry in instance network info cache for port ccf2d9f7-9747-4452-9248-874c2b8b23cf. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:33:06 user nova-compute[71482]: DEBUG nova.network.neutron [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Updating instance_info_cache with network_info: [{"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:33:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b59c022-1345-4128-9d06-8402aeff9845 req-315972ae-a53d-409e-886d-7506bb87c07d service nova] Releasing lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:33:07 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:33:08 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Creating image(s)
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Ensure instance console log exists: /opt/stack/data/nova/instances/cd463b2a-f10b-424a-b199-c8db4aa486bf/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Start _get_guest_xml network_info=[{"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '96fcbb26-83c7-41fd-9c78-bc5696fd6ac0', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwZjbuUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cd463b2a-f10b-424a-b199-c8db4aa486bf', 'attached_at': '', 'detached_at': '', 'volume_id': '8004e131-a0ca-4d62-9c3b-2d379228886e', 'serial': '8004e131-a0ca-4d62-9c3b-2d379228886e'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:33:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:33:08 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwZjbuUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:33:08 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:33:08 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:33:08 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bb2938-b70f-4d5e-af01-eefd61ea113b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:33:08 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b4c7a3-408a-4ab6-b25a-347015d008e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e] added
Apr 12 09:33:08 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a131ab0a-7f05-4c47-8422-117e0df36646]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60ee772-576b-42f0-9923-1207715726f2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwZjbuUO {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwZjbuUO" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab98273-ef21-49f1-890f-d115f4cb4fd8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iwZjbuUO'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a06e27-c4fd-4e79-b684-6d0e95a17fa4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[380bbe30-e1fe-4245-bf9b-2c91ed6ca738]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:33:08 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:33:08 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:33:08 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:33:08 user nova-compute[71482]: 
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35356669-64eb-4da1-b436-a6f78faa1e47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e, portal: 172.16.0.220,3260]
Apr 12 09:33:08 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e, portal: 172.16.0.220,3260] successful.
Apr 12 09:33:08 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bd1ec3-6d0d-4a3c-b7be-224d97ef8014]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b1d759-c8d2-462d-b02c-fa2961b2d1f7]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:33:08 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:33:08 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f3943f-12ea-4a64-a818-b902ded478d1]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:33:08 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:33:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:33:09 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:33:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwZjbuUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:33:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:33:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23337383536633566', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:33:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337383536633566', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:33:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-241380053',display_name='tempest-TestVolumeBootPattern-volume-backed-server-241380053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-241380053',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-txb41wmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:33:04Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=cd463b2a-f10b-424a-b199-c8db4aa486bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:e2:2b,bridge_name='br-int',has_traffic_filtering=True,id=ccf2d9f7-9747-4452-9248-874c2b8b23cf,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2d9f7-97') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG nova.objects.instance [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'pci_devices' on Instance uuid cd463b2a-f10b-424a-b199-c8db4aa486bf {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:33:10 user nova-compute[71482]:   <uuid>cd463b2a-f10b-424a-b199-c8db4aa486bf</uuid>
Apr 12 09:33:10 user nova-compute[71482]:   <name>instance-00000024</name>
Apr 12 09:33:10 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:33:10 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:33:10 user nova-compute[71482]:   <metadata>
Apr 12 09:33:10 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:33:10 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:33:10 user nova-compute[71482]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-241380053</nova:name>
Apr 12 09:33:10 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:33:08</nova:creationTime>
Apr 12 09:33:10 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:33:10 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:33:10 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:33:10 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:33:10 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:33:10 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:33:10 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:33:10 user nova-compute[71482]:       <nova:owner>
Apr 12 09:33:10 user nova-compute[71482]:         <nova:user uuid="4d3fba65a6ff4e73addd3ec6cdbb08cf">tempest-TestVolumeBootPattern-757175647-project-member</nova:user>
Apr 12 09:33:10 user nova-compute[71482]:         <nova:project uuid="1a0437bfee4545949707443636e07b80">tempest-TestVolumeBootPattern-757175647</nova:project>
Apr 12 09:33:10 user nova-compute[71482]:       </nova:owner>
Apr 12 09:33:10 user nova-compute[71482]:       <nova:ports>
Apr 12 09:33:10 user nova-compute[71482]:         <nova:port uuid="ccf2d9f7-9747-4452-9248-874c2b8b23cf">
Apr 12 09:33:10 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 09:33:10 user nova-compute[71482]:         </nova:port>
Apr 12 09:33:10 user nova-compute[71482]:       </nova:ports>
Apr 12 09:33:10 user nova-compute[71482]:     </nova:instance>
Apr 12 09:33:10 user nova-compute[71482]:   </metadata>
Apr 12 09:33:10 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:33:10 user nova-compute[71482]:     <system>
Apr 12 09:33:10 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:33:10 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:33:10 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:33:10 user nova-compute[71482]:       <entry name="serial">cd463b2a-f10b-424a-b199-c8db4aa486bf</entry>
Apr 12 09:33:10 user nova-compute[71482]:       <entry name="uuid">cd463b2a-f10b-424a-b199-c8db4aa486bf</entry>
Apr 12 09:33:10 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:33:10 user nova-compute[71482]:     </system>
Apr 12 09:33:10 user nova-compute[71482]:   </sysinfo>
Apr 12 09:33:10 user nova-compute[71482]:   <os>
Apr 12 09:33:10 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:33:10 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:33:10 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:33:10 user nova-compute[71482]:   </os>
Apr 12 09:33:10 user nova-compute[71482]:   <features>
Apr 12 09:33:10 user nova-compute[71482]:     <acpi/>
Apr 12 09:33:10 user nova-compute[71482]:     <apic/>
Apr 12 09:33:10 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:33:10 user nova-compute[71482]:   </features>
Apr 12 09:33:10 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:33:10 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:33:10 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:33:10 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:33:10 user nova-compute[71482]:   </clock>
Apr 12 09:33:10 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:33:10 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:33:10 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:33:10 user nova-compute[71482]:   </cpu>
Apr 12 09:33:10 user nova-compute[71482]:   <devices>
Apr 12 09:33:10 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:33:10 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:33:10 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:33:10 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:33:10 user nova-compute[71482]:       <serial>8004e131-a0ca-4d62-9c3b-2d379228886e</serial>
Apr 12 09:33:10 user nova-compute[71482]:     </disk>
Apr 12 09:33:10 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:33:10 user nova-compute[71482]:       <mac address="fa:16:3e:94:e2:2b"/>
Apr 12 09:33:10 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:33:10 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:33:10 user nova-compute[71482]:       <target dev="tapccf2d9f7-97"/>
Apr 12 09:33:10 user nova-compute[71482]:     </interface>
Apr 12 09:33:10 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:33:10 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/cd463b2a-f10b-424a-b199-c8db4aa486bf/console.log" append="off"/>
Apr 12 09:33:10 user nova-compute[71482]:     </serial>
Apr 12 09:33:10 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:33:10 user nova-compute[71482]:     <video>
Apr 12 09:33:10 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:33:10 user nova-compute[71482]:     </video>
Apr 12 09:33:10 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:33:10 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:33:10 user nova-compute[71482]:     </rng>
Apr 12 09:33:10 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:33:10 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:33:10 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:33:10 user nova-compute[71482]:     </memballoon>
Apr 12 09:33:10 user nova-compute[71482]:   </devices>
Apr 12 09:33:10 user nova-compute[71482]: </domain>
Apr 12 09:33:10 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-241380053',display_name='tempest-TestVolumeBootPattern-volume-backed-server-241380053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-241380053',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-txb41wmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:33:04Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=cd463b2a-f10b-424a-b199-c8db4aa486bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:e2:2b,bridge_name='br-int',has_traffic_filtering=True,id=ccf2d9f7-9747-4452-9248-874c2b8b23cf,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2d9f7-97') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG os_vif [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:e2:2b,bridge_name='br-int',has_traffic_filtering=True,id=ccf2d9f7-9747-4452-9248-874c2b8b23cf,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2d9f7-97') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccf2d9f7-97, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapccf2d9f7-97, col_values=(('external_ids', {'iface-id': 'ccf2d9f7-9747-4452-9248-874c2b8b23cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:e2:2b', 'vm-uuid': 'cd463b2a-f10b-424a-b199-c8db4aa486bf'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:10 user nova-compute[71482]: INFO os_vif [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:e2:2b,bridge_name='br-int',has_traffic_filtering=True,id=ccf2d9f7-9747-4452-9248-874c2b8b23cf,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2d9f7-97')
Apr 12 09:33:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:33:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No VIF found with MAC fa:16:3e:94:e2:2b, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received event network-vif-plugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] Acquiring lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] No waiting events found dispatching network-vif-plugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:33:11 user nova-compute[71482]: WARNING nova.compute.manager [req-fd2a6eac-a58f-40a2-9f0d-3f30240acbb7 req-d8711dd9-0475-43f5-a053-31a05b623e95 service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received unexpected event network-vif-plugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance with vm_state building and task_state spawning.
Apr 12 09:33:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291993.4400413, cd463b2a-f10b-424a-b199-c8db4aa486bf => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:33:13 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] VM Resumed (Lifecycle Event)
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:33:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Instance spawned successfully.
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:33:13 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681291993.4413989, cd463b2a-f10b-424a-b199-c8db4aa486bf => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:33:13 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] VM Started (Lifecycle Event)
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:33:13 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:33:13 user nova-compute[71482]: INFO nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Took 4.97 seconds to spawn the instance on the hypervisor.
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received event network-vif-plugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] Acquiring lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] No waiting events found dispatching network-vif-plugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:33:13 user nova-compute[71482]: WARNING nova.compute.manager [req-5dc19d1e-49ca-4de5-9d37-ba8a7f5907cf req-b409ae1f-2794-4e43-90db-46786ee3b3be service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received unexpected event network-vif-plugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance with vm_state building and task_state spawning.
Apr 12 09:33:13 user nova-compute[71482]: INFO nova.compute.manager [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Took 9.98 seconds to build instance.
Apr 12 09:33:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1a28334f-dede-45a5-a077-b7a58d65c6ce tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.066s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:33:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:33:17 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:33:17 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:33:17 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=26.326095581054688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance cd463b2a-f10b-424a-b199-c8db4aa486bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:33:17 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:33:18 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:33:18 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:33:18 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:33:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:33:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:33:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:33:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:33:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:33:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:33:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:33:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid 16ed5717-a2c5-469a-b1c8-2577b4debc2f {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updating instance_info_cache with network_info: [{"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-16ed5717-a2c5-469a-b1c8-2577b4debc2f" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:34:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:34:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:34:02 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:34:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:34:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:05 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:34:05 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:34:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:34:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:34:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:34:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:34:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:34:19 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:34:19 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:34:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8724MB free_disk=26.323246002197266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance cd463b2a-f10b-424a-b199-c8db4aa486bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:34:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:34:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:34:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "a191c232-c08d-498c-9f1d-5314d7c4f7db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:45 user nova-compute[71482]: DEBUG nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:34:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:45 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:34:45 user nova-compute[71482]: INFO nova.compute.claims [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Claim successful on node user
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.229s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.network.neutron [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:34:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:34:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Creating image(s)
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "/opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "/opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "/opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.policy [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6db9d274ddb5416f9f3b18de682dab1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335f10fd7d6d4ccaae33d43e406eba03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.166s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk 1073741824" returned: 0 in 0.053s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:34:46 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Successfully created port: b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Cannot resize image /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.objects.instance [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lazy-loading 'migration_context' on Instance uuid a191c232-c08d-498c-9f1d-5314d7c4f7db {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Ensure instance console log exists: /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Successfully updated port: b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "refresh_cache-a191c232-c08d-498c-9f1d-5314d7c4f7db" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquired lock "refresh_cache-a191c232-c08d-498c-9f1d-5314d7c4f7db" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received event network-changed-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Refreshing instance network info cache due to event network-changed-b325a09c-c4b3-4d26-994b-809fbc14c389. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] Acquiring lock "refresh_cache-a191c232-c08d-498c-9f1d-5314d7c4f7db" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:34:47 user nova-compute[71482]: DEBUG nova.network.neutron [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.network.neutron [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Updating instance_info_cache with network_info: [{"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Releasing lock "refresh_cache-a191c232-c08d-498c-9f1d-5314d7c4f7db" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Instance network_info: |[{"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] Acquired lock "refresh_cache-a191c232-c08d-498c-9f1d-5314d7c4f7db" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Refreshing network info cache for port b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Start _get_guest_xml network_info=[{"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:34:48 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:34:48 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-819574104',display_name='tempest-VolumesActionsTest-instance-819574104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-819574104',id=37,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f10fd7d6d4ccaae33d43e406eba03',ramdisk_id='',reservation_id='r-cajkvq9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-650670230',owner_user_name='tempest-VolumesActionsTest-650670230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:34:46Z,user_data=None,user_id='6db9d274ddb5416f9f3b18de682dab1b',uuid=a191c232-c08d-498c-9f1d-5314d7c4f7db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Converting VIF {"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=b325a09c-c4b3-4d26-994b-809fbc14c389,network=Network(ddff0553-08b4-42f5-b9ab-cc1d48b41cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb325a09c-c4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.objects.instance [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lazy-loading 'pci_devices' on Instance uuid a191c232-c08d-498c-9f1d-5314d7c4f7db {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:34:48 user nova-compute[71482]:   <uuid>a191c232-c08d-498c-9f1d-5314d7c4f7db</uuid>
Apr 12 09:34:48 user nova-compute[71482]:   <name>instance-00000025</name>
Apr 12 09:34:48 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:34:48 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:34:48 user nova-compute[71482]:   <metadata>
Apr 12 09:34:48 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:34:48 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:34:48 user nova-compute[71482]:       <nova:name>tempest-VolumesActionsTest-instance-819574104</nova:name>
Apr 12 09:34:48 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:34:48</nova:creationTime>
Apr 12 09:34:48 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:34:48 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:34:48 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:34:48 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:34:48 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:34:48 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:34:48 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:34:48 user nova-compute[71482]:       <nova:owner>
Apr 12 09:34:48 user nova-compute[71482]:         <nova:user uuid="6db9d274ddb5416f9f3b18de682dab1b">tempest-VolumesActionsTest-650670230-project-member</nova:user>
Apr 12 09:34:48 user nova-compute[71482]:         <nova:project uuid="335f10fd7d6d4ccaae33d43e406eba03">tempest-VolumesActionsTest-650670230</nova:project>
Apr 12 09:34:48 user nova-compute[71482]:       </nova:owner>
Apr 12 09:34:48 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:34:48 user nova-compute[71482]:       <nova:ports>
Apr 12 09:34:48 user nova-compute[71482]:         <nova:port uuid="b325a09c-c4b3-4d26-994b-809fbc14c389">
Apr 12 09:34:48 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 12 09:34:48 user nova-compute[71482]:         </nova:port>
Apr 12 09:34:48 user nova-compute[71482]:       </nova:ports>
Apr 12 09:34:48 user nova-compute[71482]:     </nova:instance>
Apr 12 09:34:48 user nova-compute[71482]:   </metadata>
Apr 12 09:34:48 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:34:48 user nova-compute[71482]:     <system>
Apr 12 09:34:48 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:34:48 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:34:48 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:34:48 user nova-compute[71482]:       <entry name="serial">a191c232-c08d-498c-9f1d-5314d7c4f7db</entry>
Apr 12 09:34:48 user nova-compute[71482]:       <entry name="uuid">a191c232-c08d-498c-9f1d-5314d7c4f7db</entry>
Apr 12 09:34:48 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:34:48 user nova-compute[71482]:     </system>
Apr 12 09:34:48 user nova-compute[71482]:   </sysinfo>
Apr 12 09:34:48 user nova-compute[71482]:   <os>
Apr 12 09:34:48 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:34:48 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:34:48 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:34:48 user nova-compute[71482]:   </os>
Apr 12 09:34:48 user nova-compute[71482]:   <features>
Apr 12 09:34:48 user nova-compute[71482]:     <acpi/>
Apr 12 09:34:48 user nova-compute[71482]:     <apic/>
Apr 12 09:34:48 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:34:48 user nova-compute[71482]:   </features>
Apr 12 09:34:48 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:34:48 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:34:48 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:34:48 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:34:48 user nova-compute[71482]:   </clock>
Apr 12 09:34:48 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:34:48 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:34:48 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:34:48 user nova-compute[71482]:   </cpu>
Apr 12 09:34:48 user nova-compute[71482]:   <devices>
Apr 12 09:34:48 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:34:48 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:34:48 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk"/>
Apr 12 09:34:48 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:34:48 user nova-compute[71482]:     </disk>
Apr 12 09:34:48 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:34:48 user nova-compute[71482]:       <mac address="fa:16:3e:30:a6:80"/>
Apr 12 09:34:48 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:34:48 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:34:48 user nova-compute[71482]:       <target dev="tapb325a09c-c4"/>
Apr 12 09:34:48 user nova-compute[71482]:     </interface>
Apr 12 09:34:48 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:34:48 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/console.log" append="off"/>
Apr 12 09:34:48 user nova-compute[71482]:     </serial>
Apr 12 09:34:48 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:34:48 user nova-compute[71482]:     <video>
Apr 12 09:34:48 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:34:48 user nova-compute[71482]:     </video>
Apr 12 09:34:48 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:34:48 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:34:48 user nova-compute[71482]:     </rng>
Apr 12 09:34:48 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:34:48 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:34:48 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:34:48 user nova-compute[71482]:     </memballoon>
Apr 12 09:34:48 user nova-compute[71482]:   </devices>
Apr 12 09:34:48 user nova-compute[71482]: </domain>
Apr 12 09:34:48 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-819574104',display_name='tempest-VolumesActionsTest-instance-819574104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-819574104',id=37,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='335f10fd7d6d4ccaae33d43e406eba03',ramdisk_id='',reservation_id='r-cajkvq9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-650670230',owner_user_name='tempest-VolumesActionsTest-650670230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:34:46Z,user_data=None,user_id='6db9d274ddb5416f9f3b18de682dab1b',uuid=a191c232-c08d-498c-9f1d-5314d7c4f7db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Converting VIF {"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=b325a09c-c4b3-4d26-994b-809fbc14c389,network=Network(ddff0553-08b4-42f5-b9ab-cc1d48b41cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb325a09c-c4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG os_vif [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=b325a09c-c4b3-4d26-994b-809fbc14c389,network=Network(ddff0553-08b4-42f5-b9ab-cc1d48b41cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb325a09c-c4') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb325a09c-c4, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb325a09c-c4, col_values=(('external_ids', {'iface-id': 'b325a09c-c4b3-4d26-994b-809fbc14c389', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:a6:80', 'vm-uuid': 'a191c232-c08d-498c-9f1d-5314d7c4f7db'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:48 user nova-compute[71482]: INFO os_vif [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=b325a09c-c4b3-4d26-994b-809fbc14c389,network=Network(ddff0553-08b4-42f5-b9ab-cc1d48b41cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb325a09c-c4')
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] No VIF found with MAC fa:16:3e:30:a6:80, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Updated VIF entry in instance network info cache for port b325a09c-c4b3-4d26-994b-809fbc14c389. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG nova.network.neutron [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Updating instance_info_cache with network_info: [{"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:34:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-6fca9a53-7418-4d0b-8f6d-185827d8c51a req-ebde7ced-f875-4fbb-b34a-a84a4301ea52 service nova] Releasing lock "refresh_cache-a191c232-c08d-498c-9f1d-5314d7c4f7db" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:34:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received event network-vif-plugged-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:34:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] Acquiring lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] No waiting events found dispatching network-vif-plugged-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:34:50 user nova-compute[71482]: WARNING nova.compute.manager [req-bdc5c252-64ab-46d2-8550-a41fcd164d48 req-53d4fc87-45b8-4692-9ac2-b8ece665db08 service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received unexpected event network-vif-plugged-b325a09c-c4b3-4d26-994b-809fbc14c389 for instance with vm_state building and task_state spawning.
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292091.6833093, a191c232-c08d-498c-9f1d-5314d7c4f7db => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:34:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] VM Resumed (Lifecycle Event)
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:34:51 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Instance spawned successfully.
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:34:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292091.6845434, a191c232-c08d-498c-9f1d-5314d7c4f7db => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:34:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] VM Started (Lifecycle Event)
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:34:51 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:34:51 user nova-compute[71482]: INFO nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Took 5.37 seconds to spawn the instance on the hypervisor.
Apr 12 09:34:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:34:51 user nova-compute[71482]: INFO nova.compute.manager [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Took 5.91 seconds to build instance.
Apr 12 09:34:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-09ebe34d-f8bc-4550-beba-7a5f0fcd1f39 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.016s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received event network-vif-plugged-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:34:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] Acquiring lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:52 user nova-compute[71482]: DEBUG nova.compute.manager [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] No waiting events found dispatching network-vif-plugged-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:34:52 user nova-compute[71482]: WARNING nova.compute.manager [req-db1a75e9-ac7f-4a2e-b51b-7d11833f3399 req-a96d8a8c-b872-41f6-aab5-6f43a39a11ce service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received unexpected event network-vif-plugged-b325a09c-c4b3-4d26-994b-809fbc14c389 for instance with vm_state active and task_state None.
Apr 12 09:34:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:34:58 user nova-compute[71482]: INFO nova.compute.claims [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Claim successful on node user
Apr 12 09:34:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:34:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:34:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:34:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:34:58 user nova-compute[71482]: INFO nova.virt.block_device [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Booting with volume snapshot c795d11c-a3d9-415c-802d-90f74527425b at /dev/vda
Apr 12 09:34:58 user nova-compute[71482]: DEBUG nova.policy [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:34:59 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Successfully created port: 5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:34:59 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Successfully updated port: 5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:34:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "refresh_cache-07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:34:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquired lock "refresh_cache-07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:34:59 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:34:59 user nova-compute[71482]: DEBUG nova.compute.manager [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received event network-changed-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:34:59 user nova-compute[71482]: DEBUG nova.compute.manager [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Refreshing instance network info cache due to event network-changed-5d85816a-a8fe-40cc-93eb-87e8dd4c9888. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:34:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] Acquiring lock "refresh_cache-07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:34:59 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Updating instance_info_cache with network_info: [{"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Releasing lock "refresh_cache-07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Instance network_info: |[{"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] Acquired lock "refresh_cache-07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG nova.network.neutron [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Refreshing network info cache for port 5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:35:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:35:01 user nova-compute[71482]: DEBUG nova.network.neutron [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Updated VIF entry in instance network info cache for port 5d85816a-a8fe-40cc-93eb-87e8dd4c9888. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:35:01 user nova-compute[71482]: DEBUG nova.network.neutron [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Updating instance_info_cache with network_info: [{"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:35:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c353c56a-f7c2-41b9-94c6-411691d87e98 req-ecba9842-c0d3-4e68-a5f0-f78890e47f41 service nova] Releasing lock "refresh_cache-07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:35:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Updating instance_info_cache with network_info: [{"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:35:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:35:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:35:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG os_brick.utils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae629e38-0229-4ed9-afe1-df96276abf5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdb3f99-bd75-4710-8dd2-2200b389cfaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9832c01-23df-456d-acdc-ae3f34c23b18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64e987-ff01-4185-a51b-3923f8825786]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:35:04 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:35:04 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[839f32ab-53a7-4e07-ae1b-37ab761e5417]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG os_brick.utils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:35:04 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Updating existing volume attachment record: e9617063-fa20-41e6-bde7-3d1523109000 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:35:07 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:07 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:35:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:35:09 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Creating image(s)
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Ensure instance console log exists: /opt/stack/data/nova/instances/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Start _get_guest_xml network_info=[{"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T09:34:55Z,direct_url=<?>,disk_format='qcow2',id=f105e0a1-6ab2-4270-ae66-5e2236b2f412,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1893081129',owner='1a0437bfee4545949707443636e07b80',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T09:34:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e9617063-fa20-41e6-bde7-3d1523109000', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnlHaPwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6', 'attached_at': '', 'detached_at': '', 'volume_id': 'c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b', 'serial': 'c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:35:09 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:35:09 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-12T09:34:55Z,direct_url=<?>,disk_format='qcow2',id=f105e0a1-6ab2-4270-ae66-5e2236b2f412,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1893081129',owner='1a0437bfee4545949707443636e07b80',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-12T09:34:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnlHaPwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:35:09 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:35:09 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:35:09 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[456b783a-badb-492c-9311-ffdd89a28aaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:35:09 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63aec98-af89-47b0-9b77-0bd846a66dbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b] added
Apr 12 09:35:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0780467b-044f-452b-833d-545653fd767f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ee361d-d72f-4737-8150-cccefc7ccdf7]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnlHaPwU {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OnlHaPwU" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ffc39e-ce4e-4d17-a15e-17ee3138d20b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OnlHaPwU'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[13efb288-d45a-4379-ae17-b89ac4c009a6]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e10af4f-f6f7-4a4d-9af1-00dab0d017b6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:35:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:35:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f897544-4f81-4016-b09b-0bc9ffe35e7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b, portal: 172.16.0.220,3260]
Apr 12 09:35:09 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b, portal: 172.16.0.220,3260] successful.
Apr 12 09:35:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b7f495-f15f-4940-b357-a5472a1f4e26]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[737c5f7a-5621-43dc-a894-ebd746ee7be2]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:35:09 user nova-compute[71482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b (non-flash)
Apr 12 09:35:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:35:09 user nova-compute[71482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b (non-flash)
Apr 12 09:35:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3ab3f6-5720-4922-8706-e849b2a14741]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:35:09 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnlHaPwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23664313161393363', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664313161393363', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-792846810',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-792846810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-792846810',id=38,image_ref='f105e0a1-6ab2-4270-ae66-5e2236b2f412',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-ebmlcy3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-757175647',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:34:58Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=5d85816a-a8fe-40cc-93eb-87e8dd4c9888,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d85816a-a8') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'pci_devices' on Instance uuid 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:35:10 user nova-compute[71482]:   <uuid>07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6</uuid>
Apr 12 09:35:10 user nova-compute[71482]:   <name>instance-00000026</name>
Apr 12 09:35:10 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:35:10 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:35:10 user nova-compute[71482]:   <metadata>
Apr 12 09:35:10 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:35:10 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:35:10 user nova-compute[71482]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-792846810</nova:name>
Apr 12 09:35:10 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:35:09</nova:creationTime>
Apr 12 09:35:10 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:35:10 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:35:10 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:35:10 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:35:10 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:35:10 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:35:10 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:35:10 user nova-compute[71482]:       <nova:owner>
Apr 12 09:35:10 user nova-compute[71482]:         <nova:user uuid="4d3fba65a6ff4e73addd3ec6cdbb08cf">tempest-TestVolumeBootPattern-757175647-project-member</nova:user>
Apr 12 09:35:10 user nova-compute[71482]:         <nova:project uuid="1a0437bfee4545949707443636e07b80">tempest-TestVolumeBootPattern-757175647</nova:project>
Apr 12 09:35:10 user nova-compute[71482]:       </nova:owner>
Apr 12 09:35:10 user nova-compute[71482]:       <nova:root type="image" uuid="f105e0a1-6ab2-4270-ae66-5e2236b2f412"/>
Apr 12 09:35:10 user nova-compute[71482]:       <nova:ports>
Apr 12 09:35:10 user nova-compute[71482]:         <nova:port uuid="5d85816a-a8fe-40cc-93eb-87e8dd4c9888">
Apr 12 09:35:10 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 09:35:10 user nova-compute[71482]:         </nova:port>
Apr 12 09:35:10 user nova-compute[71482]:       </nova:ports>
Apr 12 09:35:10 user nova-compute[71482]:     </nova:instance>
Apr 12 09:35:10 user nova-compute[71482]:   </metadata>
Apr 12 09:35:10 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:35:10 user nova-compute[71482]:     <system>
Apr 12 09:35:10 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:35:10 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:35:10 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:35:10 user nova-compute[71482]:       <entry name="serial">07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6</entry>
Apr 12 09:35:10 user nova-compute[71482]:       <entry name="uuid">07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6</entry>
Apr 12 09:35:10 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:35:10 user nova-compute[71482]:     </system>
Apr 12 09:35:10 user nova-compute[71482]:   </sysinfo>
Apr 12 09:35:10 user nova-compute[71482]:   <os>
Apr 12 09:35:10 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:35:10 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:35:10 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:35:10 user nova-compute[71482]:   </os>
Apr 12 09:35:10 user nova-compute[71482]:   <features>
Apr 12 09:35:10 user nova-compute[71482]:     <acpi/>
Apr 12 09:35:10 user nova-compute[71482]:     <apic/>
Apr 12 09:35:10 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:35:10 user nova-compute[71482]:   </features>
Apr 12 09:35:10 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:35:10 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:35:10 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:35:10 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:35:10 user nova-compute[71482]:   </clock>
Apr 12 09:35:10 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:35:10 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:35:10 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:35:10 user nova-compute[71482]:   </cpu>
Apr 12 09:35:10 user nova-compute[71482]:   <devices>
Apr 12 09:35:10 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:35:10 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:35:10 user nova-compute[71482]:       <source dev="/dev/sdc"/>
Apr 12 09:35:10 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:35:10 user nova-compute[71482]:       <serial>c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b</serial>
Apr 12 09:35:10 user nova-compute[71482]:     </disk>
Apr 12 09:35:10 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:35:10 user nova-compute[71482]:       <mac address="fa:16:3e:c7:7e:8e"/>
Apr 12 09:35:10 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:35:10 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:35:10 user nova-compute[71482]:       <target dev="tap5d85816a-a8"/>
Apr 12 09:35:10 user nova-compute[71482]:     </interface>
Apr 12 09:35:10 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:35:10 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6/console.log" append="off"/>
Apr 12 09:35:10 user nova-compute[71482]:     </serial>
Apr 12 09:35:10 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:35:10 user nova-compute[71482]:     <video>
Apr 12 09:35:10 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:35:10 user nova-compute[71482]:     </video>
Apr 12 09:35:10 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:35:10 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:35:10 user nova-compute[71482]:     </rng>
Apr 12 09:35:10 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:35:10 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:35:10 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:35:10 user nova-compute[71482]:     </memballoon>
Apr 12 09:35:10 user nova-compute[71482]:   </devices>
Apr 12 09:35:10 user nova-compute[71482]: </domain>
Apr 12 09:35:10 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-792846810',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-792846810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-792846810',id=38,image_ref='f105e0a1-6ab2-4270-ae66-5e2236b2f412',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-ebmlcy3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-757175647',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:34:58Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=5d85816a-a8fe-40cc-93eb-87e8dd4c9888,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d85816a-a8') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG os_vif [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=5d85816a-a8fe-40cc-93eb-87e8dd4c9888,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d85816a-a8') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d85816a-a8, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5d85816a-a8, col_values=(('external_ids', {'iface-id': '5d85816a-a8fe-40cc-93eb-87e8dd4c9888', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:7e:8e', 'vm-uuid': '07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:10 user nova-compute[71482]: INFO os_vif [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=5d85816a-a8fe-40cc-93eb-87e8dd4c9888,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d85816a-a8')
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:35:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No VIF found with MAC fa:16:3e:c7:7e:8e, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:35:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:12 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:35:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:35:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received event network-vif-plugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:35:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] Acquiring lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] No waiting events found dispatching network-vif-plugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:35:12 user nova-compute[71482]: WARNING nova.compute.manager [req-baa735ad-8006-43a1-a455-8a5106fe9a12 req-74335746-5f30-442f-aba8-30ff8de3d5b9 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received unexpected event network-vif-plugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance with vm_state building and task_state spawning.
Apr 12 09:35:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:35:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:13 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292113.975468, 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:35:13 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] VM Resumed (Lifecycle Event)
Apr 12 09:35:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:35:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:35:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Instance spawned successfully.
Apr 12 09:35:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:35:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:35:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:35:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:35:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:35:14 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:35:14 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292113.9774976, 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:35:14 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] VM Started (Lifecycle Event)
Apr 12 09:35:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:35:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:35:14 user nova-compute[71482]: INFO nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Took 4.89 seconds to spawn the instance on the hypervisor.
Apr 12 09:35:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:35:14 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:35:14 user nova-compute[71482]: INFO nova.compute.manager [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Took 16.08 seconds to build instance.
Apr 12 09:35:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received event network-vif-plugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:35:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] Acquiring lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] No waiting events found dispatching network-vif-plugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:35:14 user nova-compute[71482]: WARNING nova.compute.manager [req-2d921f70-a44d-438d-9bf7-03b2a4eb2c8c req-27188068-70c9-4b9b-8e38-c481adaad940 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received unexpected event network-vif-plugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance with vm_state active and task_state None.
Apr 12 09:35:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e2a99853-c21c-49b1-a92d-2a885abe2ec0 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.177s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:35:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:35:20 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:35:20 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=26.300426483154297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance cd463b2a-f10b-424a-b199-c8db4aa486bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a191c232-c08d-498c-9f1d-5314d7c4f7db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:35:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:35 user nova-compute[71482]: INFO nova.compute.manager [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Terminating instance
Apr 12 09:35:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:35:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received event network-vif-unplugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] Acquiring lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] No waiting events found dispatching network-vif-unplugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-51c496a5-7b9b-4f05-96a5-c8a712284171 req-c2385a35-eec5-4ae8-975c-a189d84cf395 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received event network-vif-unplugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:35:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Instance destroyed successfully.
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lazy-loading 'resources' on Instance uuid 16ed5717-a2c5-469a-b1c8-2577b4debc2f {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-323240227',display_name='tempest-ServersNegativeTestJSON-server-323240227',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-323240227',id=32,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:27:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcea1b997ee6450dbf603305d2812f7f',ramdisk_id='',reservation_id='r-od9d16uw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1848567648',owner_user_name='tempest-ServersNegativeTestJSON-1848567648-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:27:01Z,user_data=None,user_id='741e227a2cc7425d8b171c2a04989191',uuid=16ed5717-a2c5-469a-b1c8-2577b4debc2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converting VIF {"id": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "address": "fa:16:3e:a4:54:2f", "network": {"id": "bbc0bb34-7666-4c19-b2a4-d272ba7af767", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1415669015-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcea1b997ee6450dbf603305d2812f7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap267e3243-9c", "ovs_interfaceid": "267e3243-9c0f-454c-a691-ee2d1f4fcddf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:54:2f,bridge_name='br-int',has_traffic_filtering=True,id=267e3243-9c0f-454c-a691-ee2d1f4fcddf,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267e3243-9c') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG os_vif [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:54:2f,bridge_name='br-int',has_traffic_filtering=True,id=267e3243-9c0f-454c-a691-ee2d1f4fcddf,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267e3243-9c') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap267e3243-9c, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:35:36 user nova-compute[71482]: INFO os_vif [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:54:2f,bridge_name='br-int',has_traffic_filtering=True,id=267e3243-9c0f-454c-a691-ee2d1f4fcddf,network=Network(bbc0bb34-7666-4c19-b2a4-d272ba7af767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap267e3243-9c')
Apr 12 09:35:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Deleting instance files /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f_del
Apr 12 09:35:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Deletion of /opt/stack/data/nova/instances/16ed5717-a2c5-469a-b1c8-2577b4debc2f_del complete
Apr 12 09:35:36 user nova-compute[71482]: INFO nova.compute.manager [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Took 0.65 seconds to destroy the instance on the hypervisor.
Apr 12 09:35:36 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:35:36 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Took 0.45 seconds to deallocate network for instance.
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.compute.manager [req-eabb01ca-7825-48ac-a128-7cf1e90209b7 req-998f0dd7-8832-430d-8262-70fe4b44f365 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received event network-vif-deleted-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:35:36 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:35:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:37 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Deleted allocations for instance 16ed5717-a2c5-469a-b1c8-2577b4debc2f
Apr 12 09:35:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0071767f-7cc3-4c80-a999-4b7d4f9a167a tempest-ServersNegativeTestJSON-1848567648 tempest-ServersNegativeTestJSON-1848567648-project-member] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.458s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received event network-vif-plugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:35:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] Acquiring lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:35:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:35:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] Lock "16ed5717-a2c5-469a-b1c8-2577b4debc2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:35:38 user nova-compute[71482]: DEBUG nova.compute.manager [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] No waiting events found dispatching network-vif-plugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:35:38 user nova-compute[71482]: WARNING nova.compute.manager [req-016bc37b-788a-4486-ba6d-81d9b748008a req-6dfcfdc6-5f20-49f8-b31b-ab749a5f07d1 service nova] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Received unexpected event network-vif-plugged-267e3243-9c0f-454c-a691-ee2d1f4fcddf for instance with vm_state deleted and task_state None.
Apr 12 09:35:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:46 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:35:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:51 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292136.2182128, 16ed5717-a2c5-469a-b1c8-2577b4debc2f => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:35:51 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] VM Stopped (Lifecycle Event)
Apr 12 09:35:51 user nova-compute[71482]: DEBUG nova.compute.manager [None req-7cc4789b-59df-4f06-bcb7-a03fcca3c035 None None] [instance: 16ed5717-a2c5-469a-b1c8-2577b4debc2f] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:35:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:35:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid cd463b2a-f10b-424a-b199-c8db4aa486bf {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Updating instance_info_cache with network_info: [{"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-cd463b2a-f10b-424a-b199-c8db4aa486bf" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:36:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:04 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:05 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:05 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:36:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:36:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid cd463b2a-f10b-424a-b199-c8db4aa486bf {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid a191c232-c08d-498c-9f1d-5314d7c4f7db {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "cd463b2a-f10b-424a-b199-c8db4aa486bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "a191c232-c08d-498c-9f1d-5314d7c4f7db" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:36:19 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:36:19 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:36:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8632MB free_disk=26.311294555664062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance cd463b2a-f10b-424a-b199-c8db4aa486bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a191c232-c08d-498c-9f1d-5314d7c4f7db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:36:19 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:36:20 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:36:20 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:36:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:36:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:36:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:36:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "a191c232-c08d-498c-9f1d-5314d7c4f7db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:40 user nova-compute[71482]: INFO nova.compute.manager [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Terminating instance
Apr 12 09:36:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received event network-vif-unplugged-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] Acquiring lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] No waiting events found dispatching network-vif-unplugged-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:36:40 user nova-compute[71482]: DEBUG nova.compute.manager [req-1f77df80-d057-4806-bff0-f9e88fa44dc7 req-dad442d8-c702-408a-a065-71059433b0ab service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received event network-vif-unplugged-b325a09c-c4b3-4d26-994b-809fbc14c389 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Instance destroyed successfully.
Apr 12 09:36:41 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lazy-loading 'resources' on Instance uuid a191c232-c08d-498c-9f1d-5314d7c4f7db {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:34:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-819574104',display_name='tempest-VolumesActionsTest-instance-819574104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-819574104',id=37,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:34:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='335f10fd7d6d4ccaae33d43e406eba03',ramdisk_id='',reservation_id='r-cajkvq9x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-650670230',owner_user_name='tempest-VolumesActionsTest-650670230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:34:52Z,user_data=None,user_id='6db9d274ddb5416f9f3b18de682dab1b',uuid=a191c232-c08d-498c-9f1d-5314d7c4f7db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Converting VIF {"id": "b325a09c-c4b3-4d26-994b-809fbc14c389", "address": "fa:16:3e:30:a6:80", "network": {"id": "ddff0553-08b4-42f5-b9ab-cc1d48b41cc5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-665859120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "335f10fd7d6d4ccaae33d43e406eba03", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb325a09c-c4", "ovs_interfaceid": "b325a09c-c4b3-4d26-994b-809fbc14c389", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=b325a09c-c4b3-4d26-994b-809fbc14c389,network=Network(ddff0553-08b4-42f5-b9ab-cc1d48b41cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb325a09c-c4') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG os_vif [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=b325a09c-c4b3-4d26-994b-809fbc14c389,network=Network(ddff0553-08b4-42f5-b9ab-cc1d48b41cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb325a09c-c4') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb325a09c-c4, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:36:41 user nova-compute[71482]: INFO os_vif [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:a6:80,bridge_name='br-int',has_traffic_filtering=True,id=b325a09c-c4b3-4d26-994b-809fbc14c389,network=Network(ddff0553-08b4-42f5-b9ab-cc1d48b41cc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb325a09c-c4')
Apr 12 09:36:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Deleting instance files /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db_del
Apr 12 09:36:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Deletion of /opt/stack/data/nova/instances/a191c232-c08d-498c-9f1d-5314d7c4f7db_del complete
Apr 12 09:36:41 user nova-compute[71482]: INFO nova.compute.manager [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 12 09:36:41 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:36:41 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Took 0.57 seconds to deallocate network for instance.
Apr 12 09:36:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:36:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:42 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Deleted allocations for instance a191c232-c08d-498c-9f1d-5314d7c4f7db
Apr 12 09:36:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3e828da2-7765-4aef-97c4-f4b3e3e8e750 tempest-VolumesActionsTest-650670230 tempest-VolumesActionsTest-650670230-project-member] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.660s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received event network-vif-plugged-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:36:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] Acquiring lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] Lock "a191c232-c08d-498c-9f1d-5314d7c4f7db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] No waiting events found dispatching network-vif-plugged-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:36:42 user nova-compute[71482]: WARNING nova.compute.manager [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received unexpected event network-vif-plugged-b325a09c-c4b3-4d26-994b-809fbc14c389 for instance with vm_state deleted and task_state None.
Apr 12 09:36:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-2752f906-39ba-4358-b532-9a8c86a2595a req-23c95dd0-2ea1-43cb-8907-1b858bdc220d service nova] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Received event network-vif-deleted-b325a09c-c4b3-4d26-994b-809fbc14c389 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:36:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:48 user nova-compute[71482]: INFO nova.compute.manager [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Terminating instance
Apr 12 09:36:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received event network-vif-unplugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] Acquiring lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] No waiting events found dispatching network-vif-unplugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-db501d68-5905-49bd-bace-16814c3df4d9 req-0cd4f3b7-15c1-4bdb-b2cc-87e7de2d3546 service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received event network-vif-unplugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:49 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Instance destroyed successfully.
Apr 12 09:36:49 user nova-compute[71482]: DEBUG nova.objects.instance [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'resources' on Instance uuid 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:34:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-792846810',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-792846810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-792846810',id=38,image_ref='f105e0a1-6ab2-4270-ae66-5e2236b2f412',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:35:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-ebmlcy3p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-757175647',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:35:14Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "address": "fa:16:3e:c7:7e:8e", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d85816a-a8", "ovs_interfaceid": "5d85816a-a8fe-40cc-93eb-87e8dd4c9888", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=5d85816a-a8fe-40cc-93eb-87e8dd4c9888,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d85816a-a8') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_vif [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=5d85816a-a8fe-40cc-93eb-87e8dd4c9888,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d85816a-a8') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d85816a-a8, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:36:49 user nova-compute[71482]: INFO os_vif [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:7e:8e,bridge_name='br-int',has_traffic_filtering=True,id=5d85816a-a8fe-40cc-93eb-87e8dd4c9888,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d85816a-a8')
Apr 12 09:36:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OnlHaPwU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:36:49 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[af09c409-510f-469f-8d73-128ab80f3023]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:36:49 user nova-compute[71482]: No targets found.
Apr 12 09:36:49 user nova-compute[71482]: iSNS:
Apr 12 09:36:49 user nova-compute[71482]: No targets found.
Apr 12 09:36:49 user nova-compute[71482]: STATIC:
Apr 12 09:36:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e
Apr 12 09:36:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:36:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:36:49 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b
Apr 12 09:36:49 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:36:49 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:36:49 user nova-compute[71482]: FIRMWARE:
Apr 12 09:36:49 user nova-compute[71482]: No targets found.
Apr 12 09:36:49 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:36:49 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:36:49 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[750ffef5-15d2-435c-b9e2-adf418a70923]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[97171399-2b66-4e64-88a6-137cb03fb055]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:36:49 user nova-compute[71482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b (non-flash)
Apr 12 09:36:49 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:36:49 user nova-compute[71482]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b (non-flash)
Apr 12 09:36:49 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f930853e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4539225d-2255-4a51-b7a9-8acd98a69ee6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fd493b-874b-4d12-89aa-17666f603b40]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8660e55c-a913-4136-88d4-78088923c4f4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92b1d2e-205d-445a-93d4-d8e22d13b9da]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23664313161393363', '/dev/disk/by-id/scsi-1SCST_BIOfce77-6d11a93cce18bfef', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fce77') {{(pid=82392) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccc9a62-3129-41ce-952d-7d13e8ed492e]: (4, None) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5f6270-5c2c-4e73-9b06-b87ea96cc012]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03f8359-91fa-401f-bd0d-2f8c1466297f]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b, portal: 172.16.0.220,3260]
Apr 12 09:36:49 user nova-compute[71482]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b, portal: 172.16.0.220,3260] successful.
Apr 12 09:36:49 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec6e4b6-e6d1-4379-8dec-851ab0d982ca]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== disconnect_volume: return (314ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:36:49 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Deleting instance files /opt/stack/data/nova/instances/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6_del
Apr 12 09:36:49 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Deletion of /opt/stack/data/nova/instances/07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6_del complete
Apr 12 09:36:49 user nova-compute[71482]: INFO nova.compute.manager [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 12 09:36:49 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:36:49 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:36:49 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Took 0.43 seconds to deallocate network for instance.
Apr 12 09:36:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received event network-vif-plugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:36:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] Acquiring lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] No waiting events found dispatching network-vif-plugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:36:50 user nova-compute[71482]: WARNING nova.compute.manager [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received unexpected event network-vif-plugged-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 for instance with vm_state active and task_state deleting.
Apr 12 09:36:50 user nova-compute[71482]: DEBUG nova.compute.manager [req-b38428f9-5ee1-4153-9f72-1238304f25ff req-807b82dc-3f98-41b0-b7d7-f678d6a7bf5d service nova] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Received event network-vif-deleted-5d85816a-a8fe-40cc-93eb-87e8dd4c9888 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:36:50 user nova-compute[71482]: INFO nova.compute.manager [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Took 0.77 seconds to detach 1 volumes for instance.
Apr 12 09:36:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Deleting volume: c540e7ff-2ab0-4c8f-bbf0-101ef2c9915b {{(pid=71482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 09:36:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:36:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:36:50 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:36:50 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:36:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:50 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Deleted allocations for instance 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6
Apr 12 09:36:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-ebcf506e-a873-4000-aa53-de23268c669e tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.734s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:36:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:36:56 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292201.0886924, a191c232-c08d-498c-9f1d-5314d7c4f7db => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:36:56 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] VM Stopped (Lifecycle Event)
Apr 12 09:36:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-51d8121c-2458-433d-8c37-81ba1d85e635 None None] [instance: a191c232-c08d-498c-9f1d-5314d7c4f7db] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:36:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:37:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:37:02 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:04 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292209.0720813, 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:37:04 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] VM Stopped (Lifecycle Event)
Apr 12 09:37:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-fbcb3012-8b01-46f5-ab10-f64853df3ec6 None None] [instance: 07dcbb3e-6e94-4ee1-bd2a-c210d0230fa6] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:37:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:37:05 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:06 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:06 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:07 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:37:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:37:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:37:16 user nova-compute[71482]: INFO nova.compute.claims [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Claim successful on node user
Apr 12 09:37:16 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.208s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:37:16 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:37:17 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.policy [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b2402ddb2264bc19341580cc719c706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7b1c70322c4f31a30e0294291aa165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:37:17 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Creating image(s)
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "/opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "/opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.128s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk 1073741824" returned: 0 in 0.054s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Successfully created port: 8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Cannot resize image /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.objects.instance [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'migration_context' on Instance uuid d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Ensure instance console log exists: /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Successfully updated port: 8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquired lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received event network-changed-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Refreshing instance network info cache due to event network-changed-8c15ba29-fa31-4056-a248-840557a7a18a. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] Acquiring lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.network.neutron [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Updating instance_info_cache with network_info: [{"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Releasing lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Instance network_info: |[{"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] Acquired lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Refreshing network info cache for port 8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Start _get_guest_xml network_info=[{"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:37:18 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:37:18 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2125995582',display_name='tempest-VolumesSnapshotTestJSON-instance-2125995582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2125995582',id=39,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b7b1c70322c4f31a30e0294291aa165',ramdisk_id='',reservation_id='r-c1xbuxng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1644949007',owner_user_name='tempest-VolumesSnapshotTestJSON-1644949007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:37:17Z,user_data=None,user_id='7b2402ddb2264bc19341580cc719c706',uuid=d4bf54e3-c4cd-4f1e-a0c3-eec827238982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converting VIF {"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c15ba29-fa31-4056-a248-840557a7a18a,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c15ba29-fa') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.objects.instance [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'pci_devices' on Instance uuid d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:37:18 user nova-compute[71482]:   <uuid>d4bf54e3-c4cd-4f1e-a0c3-eec827238982</uuid>
Apr 12 09:37:18 user nova-compute[71482]:   <name>instance-00000027</name>
Apr 12 09:37:18 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:37:18 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:37:18 user nova-compute[71482]:   <metadata>
Apr 12 09:37:18 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:37:18 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:37:18 user nova-compute[71482]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2125995582</nova:name>
Apr 12 09:37:18 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:37:18</nova:creationTime>
Apr 12 09:37:18 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:37:18 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:37:18 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:37:18 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:37:18 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:37:18 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:37:18 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:37:18 user nova-compute[71482]:       <nova:owner>
Apr 12 09:37:18 user nova-compute[71482]:         <nova:user uuid="7b2402ddb2264bc19341580cc719c706">tempest-VolumesSnapshotTestJSON-1644949007-project-member</nova:user>
Apr 12 09:37:18 user nova-compute[71482]:         <nova:project uuid="5b7b1c70322c4f31a30e0294291aa165">tempest-VolumesSnapshotTestJSON-1644949007</nova:project>
Apr 12 09:37:18 user nova-compute[71482]:       </nova:owner>
Apr 12 09:37:18 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:37:18 user nova-compute[71482]:       <nova:ports>
Apr 12 09:37:18 user nova-compute[71482]:         <nova:port uuid="8c15ba29-fa31-4056-a248-840557a7a18a">
Apr 12 09:37:18 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 12 09:37:18 user nova-compute[71482]:         </nova:port>
Apr 12 09:37:18 user nova-compute[71482]:       </nova:ports>
Apr 12 09:37:18 user nova-compute[71482]:     </nova:instance>
Apr 12 09:37:18 user nova-compute[71482]:   </metadata>
Apr 12 09:37:18 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:37:18 user nova-compute[71482]:     <system>
Apr 12 09:37:18 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:37:18 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:37:18 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:37:18 user nova-compute[71482]:       <entry name="serial">d4bf54e3-c4cd-4f1e-a0c3-eec827238982</entry>
Apr 12 09:37:18 user nova-compute[71482]:       <entry name="uuid">d4bf54e3-c4cd-4f1e-a0c3-eec827238982</entry>
Apr 12 09:37:18 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:37:18 user nova-compute[71482]:     </system>
Apr 12 09:37:18 user nova-compute[71482]:   </sysinfo>
Apr 12 09:37:18 user nova-compute[71482]:   <os>
Apr 12 09:37:18 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:37:18 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:37:18 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:37:18 user nova-compute[71482]:   </os>
Apr 12 09:37:18 user nova-compute[71482]:   <features>
Apr 12 09:37:18 user nova-compute[71482]:     <acpi/>
Apr 12 09:37:18 user nova-compute[71482]:     <apic/>
Apr 12 09:37:18 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:37:18 user nova-compute[71482]:   </features>
Apr 12 09:37:18 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:37:18 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:37:18 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:37:18 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:37:18 user nova-compute[71482]:   </clock>
Apr 12 09:37:18 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:37:18 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:37:18 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:37:18 user nova-compute[71482]:   </cpu>
Apr 12 09:37:18 user nova-compute[71482]:   <devices>
Apr 12 09:37:18 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:37:18 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:37:18 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk"/>
Apr 12 09:37:18 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:37:18 user nova-compute[71482]:     </disk>
Apr 12 09:37:18 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:37:18 user nova-compute[71482]:       <mac address="fa:16:3e:34:49:d0"/>
Apr 12 09:37:18 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:37:18 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:37:18 user nova-compute[71482]:       <target dev="tap8c15ba29-fa"/>
Apr 12 09:37:18 user nova-compute[71482]:     </interface>
Apr 12 09:37:18 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:37:18 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/console.log" append="off"/>
Apr 12 09:37:18 user nova-compute[71482]:     </serial>
Apr 12 09:37:18 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:37:18 user nova-compute[71482]:     <video>
Apr 12 09:37:18 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:37:18 user nova-compute[71482]:     </video>
Apr 12 09:37:18 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:37:18 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:37:18 user nova-compute[71482]:     </rng>
Apr 12 09:37:18 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:37:18 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:37:18 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:37:18 user nova-compute[71482]:     </memballoon>
Apr 12 09:37:18 user nova-compute[71482]:   </devices>
Apr 12 09:37:18 user nova-compute[71482]: </domain>
Apr 12 09:37:18 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2125995582',display_name='tempest-VolumesSnapshotTestJSON-instance-2125995582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2125995582',id=39,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b7b1c70322c4f31a30e0294291aa165',ramdisk_id='',reservation_id='r-c1xbuxng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1644949007',owner_user_name='tempest-VolumesSnapshotTestJSON-1644949007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:37:17Z,user_data=None,user_id='7b2402ddb2264bc19341580cc719c706',uuid=d4bf54e3-c4cd-4f1e-a0c3-eec827238982,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converting VIF {"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c15ba29-fa31-4056-a248-840557a7a18a,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c15ba29-fa') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG os_vif [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c15ba29-fa31-4056-a248-840557a7a18a,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c15ba29-fa') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c15ba29-fa, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c15ba29-fa, col_values=(('external_ids', {'iface-id': '8c15ba29-fa31-4056-a248-840557a7a18a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:49:d0', 'vm-uuid': 'd4bf54e3-c4cd-4f1e-a0c3-eec827238982'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:37:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:18 user nova-compute[71482]: INFO os_vif [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c15ba29-fa31-4056-a248-840557a7a18a,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c15ba29-fa')
Apr 12 09:37:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:37:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No VIF found with MAC fa:16:3e:34:49:d0, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:37:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Updated VIF entry in instance network info cache for port 8c15ba29-fa31-4056-a248-840557a7a18a. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:37:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Updating instance_info_cache with network_info: [{"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:37:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bcc7dbc8-fc32-4233-865e-f1969ab3bebf req-bf9fa162-4a29-4787-8984-a225e9f6515a service nova] Releasing lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received event network-vif-plugged-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] No waiting events found dispatching network-vif-plugged-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:37:20 user nova-compute[71482]: WARNING nova.compute.manager [req-ce869e82-bcd9-4438-a9dd-82f6ad575368 req-fd6396c7-7f6a-43ed-956b-06b7e03ff80c service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received unexpected event network-vif-plugged-8c15ba29-fa31-4056-a248-840557a7a18a for instance with vm_state building and task_state spawning.
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:37:21 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:37:21 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:37:21 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8742MB free_disk=26.325794219970703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance cd463b2a-f10b-424a-b199-c8db4aa486bf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:37:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292242.4123461, d4bf54e3-c4cd-4f1e-a0c3-eec827238982 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:37:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] VM Resumed (Lifecycle Event)
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:37:22 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Instance spawned successfully.
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:37:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292242.4141471, d4bf54e3-c4cd-4f1e-a0c3-eec827238982 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:37:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] VM Started (Lifecycle Event)
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:37:22 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:37:22 user nova-compute[71482]: INFO nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Took 5.39 seconds to spawn the instance on the hypervisor.
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:37:22 user nova-compute[71482]: INFO nova.compute.manager [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Took 5.92 seconds to build instance.
Apr 12 09:37:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9439c60d-e5e4-460f-ae70-b0a2c48dec3a tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.018s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received event network-vif-plugged-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:22 user nova-compute[71482]: DEBUG nova.compute.manager [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] No waiting events found dispatching network-vif-plugged-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:37:22 user nova-compute[71482]: WARNING nova.compute.manager [req-e576fc93-9d73-4d1e-8a4a-0fd8dce3ae0b req-4151cdd0-3e7e-4c06-9af0-ee00d69ba9e7 service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received unexpected event network-vif-plugged-8c15ba29-fa31-4056-a248-840557a7a18a for instance with vm_state active and task_state None.
Apr 12 09:37:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "cd463b2a-f10b-424a-b199-c8db4aa486bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:40 user nova-compute[71482]: INFO nova.compute.manager [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Terminating instance
Apr 12 09:37:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:37:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received event network-vif-unplugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] Acquiring lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] No waiting events found dispatching network-vif-unplugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG nova.compute.manager [req-11eb1382-6ccc-48ef-b570-c7cd3c739dd8 req-1055833f-f830-433e-93e3-28f8a153fc4f service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received event network-vif-unplugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Instance destroyed successfully.
Apr 12 09:37:41 user nova-compute[71482]: DEBUG nova.objects.instance [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'resources' on Instance uuid cd463b2a-f10b-424a-b199-c8db4aa486bf {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:33:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-241380053',display_name='tempest-TestVolumeBootPattern-volume-backed-server-241380053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-241380053',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:33:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-txb41wmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:33:14Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=cd463b2a-f10b-424a-b199-c8db4aa486bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "address": "fa:16:3e:94:e2:2b", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccf2d9f7-97", "ovs_interfaceid": "ccf2d9f7-9747-4452-9248-874c2b8b23cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:e2:2b,bridge_name='br-int',has_traffic_filtering=True,id=ccf2d9f7-9747-4452-9248-874c2b8b23cf,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2d9f7-97') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_vif [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:e2:2b,bridge_name='br-int',has_traffic_filtering=True,id=ccf2d9f7-9747-4452-9248-874c2b8b23cf,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2d9f7-97') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccf2d9f7-97, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:37:41 user nova-compute[71482]: INFO os_vif [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:e2:2b,bridge_name='br-int',has_traffic_filtering=True,id=ccf2d9f7-9747-4452-9248-874c2b8b23cf,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccf2d9f7-97')
Apr 12 09:37:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwZjbuUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:37:41 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbf42c7-6a2d-41b4-ae06-ce72e66e7fd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:37:41 user nova-compute[71482]: No targets found.
Apr 12 09:37:41 user nova-compute[71482]: iSNS:
Apr 12 09:37:41 user nova-compute[71482]: No targets found.
Apr 12 09:37:41 user nova-compute[71482]: STATIC:
Apr 12 09:37:41 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e
Apr 12 09:37:41 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:37:41 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:37:41 user nova-compute[71482]: FIRMWARE:
Apr 12 09:37:41 user nova-compute[71482]: No targets found.
Apr 12 09:37:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:37:41 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:37:41 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[346f3b9d-7633-4b76-b74a-8c55613d74b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b73279-5759-4158-aef8-42922ea07bde]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:37:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e (non-flash)
Apr 12 09:37:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c280670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[30305bc4-7d46-4793-ad69-6675add4a5b7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a307c59-71ce-44bb-824f-65890e03819b]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e25a172-1bb2-4ac4-9c98-f09832d69d1d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e581d7c6-3bad-4f4f-9488-d741c84b1093]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23337383536633566', '/dev/disk/by-id/scsi-1SCST_BIO86feb2e2-37856c5fd7096a20', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_86feb2e2') {{(pid=82392) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bdb9f8-13e3-45ea-b5bb-ae0561cbb89f]: (4, None) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2f2ab8-d944-4881-9ded-f3ea579c7b48]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcdf8e8-665b-4254-b620-88059dfe6d36]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e, portal: 172.16.0.220,3260]
Apr 12 09:37:41 user nova-compute[71482]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e, portal: 172.16.0.220,3260] successful.
Apr 12 09:37:41 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8004e131-a0ca-4d62-9c3b-2d379228886e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4568eb6-f7d2-4f5b-8f18-fb56e7dcbad4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== disconnect_volume: return (319ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:37:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:37:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Deleting instance files /opt/stack/data/nova/instances/cd463b2a-f10b-424a-b199-c8db4aa486bf_del
Apr 12 09:37:41 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Deletion of /opt/stack/data/nova/instances/cd463b2a-f10b-424a-b199-c8db4aa486bf_del complete
Apr 12 09:37:42 user nova-compute[71482]: INFO nova.compute.manager [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 12 09:37:42 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:37:42 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:37:42 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:37:42 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:37:42 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Took 0.50 seconds to deallocate network for instance.
Apr 12 09:37:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received event network-vif-plugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] Acquiring lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] No waiting events found dispatching network-vif-plugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:37:43 user nova-compute[71482]: WARNING nova.compute.manager [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received unexpected event network-vif-plugged-ccf2d9f7-9747-4452-9248-874c2b8b23cf for instance with vm_state active and task_state deleting.
Apr 12 09:37:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-e3351004-f492-490f-95e1-56c4cb955747 req-1217cd0e-67ee-433b-9e0d-ba138fc20f6b service nova] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Received event network-vif-deleted-ccf2d9f7-9747-4452-9248-874c2b8b23cf {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:37:43 user nova-compute[71482]: INFO nova.compute.manager [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Took 0.91 seconds to detach 1 volumes for instance.
Apr 12 09:37:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Deleting volume: 8004e131-a0ca-4d62-9c3b-2d379228886e {{(pid=71482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:43 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Deleted allocations for instance cd463b2a-f10b-424a-b199-c8db4aa486bf
Apr 12 09:37:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9672ef4-24a2-4788-9a60-c8ef6a5d38b9 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "cd463b2a-f10b-424a-b199-c8db4aa486bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.947s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:37:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:37:56 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292261.6320925, cd463b2a-f10b-424a-b199-c8db4aa486bf => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:37:56 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] VM Stopped (Lifecycle Event)
Apr 12 09:37:56 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4723ec80-f51b-4981-9d87-e705d22c0c8a None None] [instance: cd463b2a-f10b-424a-b199-c8db4aa486bf] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:37:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:38:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:38:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:38:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:38:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:38:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:38:01 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:38:02 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Updating instance_info_cache with network_info: [{"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:38:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:38:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:38:04 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:38:06 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:38:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:38:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:38:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:07 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:38:08 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:38:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:38:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:38:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:12 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:38:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:38:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:38:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:38:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:38:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:20 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:38:20 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:38:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=26.296260833740234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:38:20 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:38:21 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:38:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:38:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:38:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:38:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:38:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "a42b12e5-5e85-4206-866f-42294318f0b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a42b12e5-5e85-4206-866f-42294318f0b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:38:37 user nova-compute[71482]: INFO nova.compute.claims [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Claim successful on node user
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:38:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:38:37 user nova-compute[71482]: INFO nova.virt.block_device [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Booting with volume d1ab1273-9a1f-422c-8d8c-85ec688d5b9a at /dev/vda
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.policy [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG os_brick.utils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca7409b-8fc9-42ba-b5fe-65add1e80410]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6314ff-6fb2-49f2-9fdb-52de0f71bdb2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[249cfad0-0382-49fc-9111-de8057386b38]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75df874-1e59-4a44-8c32-8a161d82904b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:38:37 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:38:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f7519b-0580-4886-a07c-ccf4e1691c50]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG os_brick.utils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:38:37 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Updating existing volume attachment record: 93068eca-18b9-49ea-987a-730d1aebcb71 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:38:38 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Successfully created port: 725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:38:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Successfully updated port: 725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquired lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received event network-changed-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Refreshing instance network info cache due to event network-changed-725c2a1c-abed-48f3-8fe7-f724a7552bca. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] Acquiring lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.network.neutron [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Updating instance_info_cache with network_info: [{"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Releasing lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Instance network_info: |[{"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] Acquired lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.network.neutron [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Refreshing network info cache for port 725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.network.neutron [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Updated VIF entry in instance network info cache for port 725c2a1c-abed-48f3-8fe7-f724a7552bca. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG nova.network.neutron [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Updating instance_info_cache with network_info: [{"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:38:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3dd58e34-cfc9-4e03-b7d6-8811cc8b3f9f req-5f277d84-4c60-4895-9c83-1e55bb2a9011 service nova] Releasing lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:38:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:38:43 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Creating image(s)
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Ensure instance console log exists: /opt/stack/data/nova/instances/a42b12e5-5e85-4206-866f-42294318f0b0/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Start _get_guest_xml network_info=[{"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '93068eca-18b9-49ea-987a-730d1aebcb71', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMUyezpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a42b12e5-5e85-4206-866f-42294318f0b0', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'serial': 'd1ab1273-9a1f-422c-8d8c-85ec688d5b9a'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:38:43 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:38:43 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMUyezpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:38:43 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:38:43 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:38:43 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d147cb57-8cff-49d4-af6e-235a086a6d65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:38:43 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[407597ca-e6f3-44c8-84b4-b715925bbec6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a] added
Apr 12 09:38:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46fac4a-bfe6-4323-adba-a85a98ae62aa]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[89529075-eaa0-4802-a4f3-9f967e4d4252]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMUyezpN {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMUyezpN" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c13094-9d1d-4e6f-8243-c53533446f64]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMUyezpN'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b314a14d-53e5-4e78-ac24-4eaecc54dbdd]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8061362-b045-4022-8ec6-8aefb7b86964]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:38:43 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:38:43 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:38:43 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:38:43 user nova-compute[71482]: 
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b381d2-8559-4e5c-881b-62246e122888]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260]
Apr 12 09:38:43 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260] successful.
Apr 12 09:38:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4511febe-8f42-4ca8-bcd5-fd654a0129a1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7c4fc1-ab5a-4492-b552-3e5cb0ce175e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:38:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:38:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[413bddb9-7296-4ac7-8ce6-e8d5c4809257]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:38:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMUyezpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26662623437663461', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662623437663461', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1150635585',display_name='tempest-TestVolumeBootPattern-server-1150635585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1150635585',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw==',key_name='tempest-TestVolumeBootPattern-390353875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-a2et90sj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:38:38Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=a42b12e5-5e85-4206-866f-42294318f0b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:65:b8,bridge_name='br-int',has_traffic_filtering=True,id=725c2a1c-abed-48f3-8fe7-f724a7552bca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725c2a1c-ab') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'pci_devices' on Instance uuid a42b12e5-5e85-4206-866f-42294318f0b0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:38:44 user nova-compute[71482]:   <uuid>a42b12e5-5e85-4206-866f-42294318f0b0</uuid>
Apr 12 09:38:44 user nova-compute[71482]:   <name>instance-00000028</name>
Apr 12 09:38:44 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:38:44 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:38:44 user nova-compute[71482]:   <metadata>
Apr 12 09:38:44 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:38:44 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:38:44 user nova-compute[71482]:       <nova:name>tempest-TestVolumeBootPattern-server-1150635585</nova:name>
Apr 12 09:38:44 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:38:43</nova:creationTime>
Apr 12 09:38:44 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:38:44 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:38:44 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:38:44 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:38:44 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:38:44 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:38:44 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:38:44 user nova-compute[71482]:       <nova:owner>
Apr 12 09:38:44 user nova-compute[71482]:         <nova:user uuid="4d3fba65a6ff4e73addd3ec6cdbb08cf">tempest-TestVolumeBootPattern-757175647-project-member</nova:user>
Apr 12 09:38:44 user nova-compute[71482]:         <nova:project uuid="1a0437bfee4545949707443636e07b80">tempest-TestVolumeBootPattern-757175647</nova:project>
Apr 12 09:38:44 user nova-compute[71482]:       </nova:owner>
Apr 12 09:38:44 user nova-compute[71482]:       <nova:ports>
Apr 12 09:38:44 user nova-compute[71482]:         <nova:port uuid="725c2a1c-abed-48f3-8fe7-f724a7552bca">
Apr 12 09:38:44 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:38:44 user nova-compute[71482]:         </nova:port>
Apr 12 09:38:44 user nova-compute[71482]:       </nova:ports>
Apr 12 09:38:44 user nova-compute[71482]:     </nova:instance>
Apr 12 09:38:44 user nova-compute[71482]:   </metadata>
Apr 12 09:38:44 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:38:44 user nova-compute[71482]:     <system>
Apr 12 09:38:44 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:38:44 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:38:44 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:38:44 user nova-compute[71482]:       <entry name="serial">a42b12e5-5e85-4206-866f-42294318f0b0</entry>
Apr 12 09:38:44 user nova-compute[71482]:       <entry name="uuid">a42b12e5-5e85-4206-866f-42294318f0b0</entry>
Apr 12 09:38:44 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:38:44 user nova-compute[71482]:     </system>
Apr 12 09:38:44 user nova-compute[71482]:   </sysinfo>
Apr 12 09:38:44 user nova-compute[71482]:   <os>
Apr 12 09:38:44 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:38:44 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:38:44 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:38:44 user nova-compute[71482]:   </os>
Apr 12 09:38:44 user nova-compute[71482]:   <features>
Apr 12 09:38:44 user nova-compute[71482]:     <acpi/>
Apr 12 09:38:44 user nova-compute[71482]:     <apic/>
Apr 12 09:38:44 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:38:44 user nova-compute[71482]:   </features>
Apr 12 09:38:44 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:38:44 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:38:44 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:38:44 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:38:44 user nova-compute[71482]:   </clock>
Apr 12 09:38:44 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:38:44 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:38:44 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:38:44 user nova-compute[71482]:   </cpu>
Apr 12 09:38:44 user nova-compute[71482]:   <devices>
Apr 12 09:38:44 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:38:44 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:38:44 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:38:44 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:38:44 user nova-compute[71482]:       <serial>d1ab1273-9a1f-422c-8d8c-85ec688d5b9a</serial>
Apr 12 09:38:44 user nova-compute[71482]:     </disk>
Apr 12 09:38:44 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:38:44 user nova-compute[71482]:       <mac address="fa:16:3e:b3:65:b8"/>
Apr 12 09:38:44 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:38:44 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:38:44 user nova-compute[71482]:       <target dev="tap725c2a1c-ab"/>
Apr 12 09:38:44 user nova-compute[71482]:     </interface>
Apr 12 09:38:44 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:38:44 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/a42b12e5-5e85-4206-866f-42294318f0b0/console.log" append="off"/>
Apr 12 09:38:44 user nova-compute[71482]:     </serial>
Apr 12 09:38:44 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:38:44 user nova-compute[71482]:     <video>
Apr 12 09:38:44 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:38:44 user nova-compute[71482]:     </video>
Apr 12 09:38:44 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:38:44 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:38:44 user nova-compute[71482]:     </rng>
Apr 12 09:38:44 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:38:44 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:38:44 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:38:44 user nova-compute[71482]:     </memballoon>
Apr 12 09:38:44 user nova-compute[71482]:   </devices>
Apr 12 09:38:44 user nova-compute[71482]: </domain>
Apr 12 09:38:44 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1150635585',display_name='tempest-TestVolumeBootPattern-server-1150635585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1150635585',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw==',key_name='tempest-TestVolumeBootPattern-390353875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-a2et90sj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:38:38Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=a42b12e5-5e85-4206-866f-42294318f0b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:65:b8,bridge_name='br-int',has_traffic_filtering=True,id=725c2a1c-abed-48f3-8fe7-f724a7552bca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725c2a1c-ab') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG os_vif [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:65:b8,bridge_name='br-int',has_traffic_filtering=True,id=725c2a1c-abed-48f3-8fe7-f724a7552bca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725c2a1c-ab') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap725c2a1c-ab, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap725c2a1c-ab, col_values=(('external_ids', {'iface-id': '725c2a1c-abed-48f3-8fe7-f724a7552bca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:65:b8', 'vm-uuid': 'a42b12e5-5e85-4206-866f-42294318f0b0'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:44 user nova-compute[71482]: INFO os_vif [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:65:b8,bridge_name='br-int',has_traffic_filtering=True,id=725c2a1c-abed-48f3-8fe7-f724a7552bca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725c2a1c-ab')
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:38:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No VIF found with MAC fa:16:3e:b3:65:b8, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:38:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received event network-vif-plugged-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:38:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] Acquiring lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:38:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:38:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:38:46 user nova-compute[71482]: DEBUG nova.compute.manager [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] No waiting events found dispatching network-vif-plugged-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:38:46 user nova-compute[71482]: WARNING nova.compute.manager [req-cee5becf-994f-423b-b951-04a76e03c4d6 req-efa4661e-b2c4-433a-a2dc-3739b85aa5ea service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received unexpected event network-vif-plugged-725c2a1c-abed-48f3-8fe7-f724a7552bca for instance with vm_state building and task_state spawning.
Apr 12 09:38:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292328.3979402, a42b12e5-5e85-4206-866f-42294318f0b0 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:38:48 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] VM Resumed (Lifecycle Event)
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:38:48 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Instance spawned successfully.
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:38:48 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292328.399287, a42b12e5-5e85-4206-866f-42294318f0b0 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:38:48 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] VM Started (Lifecycle Event)
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:38:48 user nova-compute[71482]: INFO nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Took 5.17 seconds to spawn the instance on the hypervisor.
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received event network-vif-plugged-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] Acquiring lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG nova.compute.manager [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] No waiting events found dispatching network-vif-plugged-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:38:48 user nova-compute[71482]: WARNING nova.compute.manager [req-cb5d3530-9f55-43b0-8ea7-d475e3df02d8 req-5c8eee6f-0520-4619-9bb7-8979d50bccfb service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received unexpected event network-vif-plugged-725c2a1c-abed-48f3-8fe7-f724a7552bca for instance with vm_state building and task_state spawning.
Apr 12 09:38:48 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:38:48 user nova-compute[71482]: INFO nova.compute.manager [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Took 11.48 seconds to build instance.
Apr 12 09:38:48 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2e760317-7207-4020-9ebc-4a4e94a4212c tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a42b12e5-5e85-4206-866f-42294318f0b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.573s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:38:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:38:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:38:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:38:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:38:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:38:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:38:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Updating instance_info_cache with network_info: [{"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-d4bf54e3-c4cd-4f1e-a0c3-eec827238982" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:39:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:39:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:04 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'flavor' on Instance uuid d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:39:06 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Ignoring supplied device name: /dev/vdb
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:06 user nova-compute[71482]: INFO nova.compute.manager [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Attaching volume 2c316b2d-328a-4863-8ee7-b216639e40ab to /dev/vdb
Apr 12 09:39:06 user nova-compute[71482]: DEBUG os_brick.utils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b1ef96-33c8-437f-b930-67e761b324ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f71db-29b4-4f18-a0e8-1ed575e746a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4491fcfc-e16b-433e-b928-a07b3a69a756]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18eade2-42da-4f20-a4f8-25b5383a93e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:39:06 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:39:06 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29a03f6-6385-416c-99cf-47dcb629415d]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG os_brick.utils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:39:06 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Updating existing volume attachment record: 1698e681-5979-4be8-aa00-34e2810e8761 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:39:07 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:08 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:08 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:10 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:39:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEQSlpYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:39:10 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:39:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:39:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:39:10 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:39:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:39:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:39:10 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:39:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:10 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2e6306-2cb0-4c56-9949-50048a32ea8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:10 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:39:10 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:10 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f41b91-56f9-4fa2-834d-abafefde9fe4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab] added
Apr 12 09:39:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9490b81e-40f1-4eff-896c-c61dad188944]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa62169b-3968-4338-a548-d2e2ccbf8bcf]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEQSlpYF {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qEQSlpYF" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db44245-1c3c-434d-afd5-d7980464798b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qEQSlpYF'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec9700-f566-4e18-b5b7-a2f9f2795590]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[713d221e-1171-471c-86b6-0d6d3d39c0e2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:39:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:39:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[03269cfe-1fc4-48e4-8b47-420fbe1fe0fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab, portal: 172.16.0.220,3260]
Apr 12 09:39:11 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab, portal: 172.16.0.220,3260] successful.
Apr 12 09:39:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[667895ec-2d62-45ce-912d-c164f2225622]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e10aaa0-99af-4d4d-ad7c-b805bbd432c7]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:39:11 user nova-compute[71482]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab (non-flash)
Apr 12 09:39:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:39:11 user nova-compute[71482]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab (non-flash)
Apr 12 09:39:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52761cc-5e74-40bb-ac3b-a5e51533cdde]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:39:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEQSlpYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:39:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:39:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23065383561343966', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:39:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23065383561343966', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:39:12 user nova-compute[71482]: DEBUG nova.objects.instance [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'flavor' on Instance uuid d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:39:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:39:12 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:39:12 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:39:12 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:39:12 user nova-compute[71482]:   <serial>2c316b2d-328a-4863-8ee7-b216639e40ab</serial>
Apr 12 09:39:12 user nova-compute[71482]: </disk>
Apr 12 09:39:12 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:39:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:39:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:39:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No VIF found with MAC fa:16:3e:34:49:d0, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:39:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-2bf6f9d1-e30d-462a-a576-809cd0be64c1 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.028s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:14 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:39:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:39:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:39:20 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:39:20 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:39:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8681MB free_disk=26.293766021728516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a42b12e5-5e85-4206-866f-42294318f0b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:39:20 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:39:21 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:39:21 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:39:21 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:39:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:39:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:26 user nova-compute[71482]: INFO nova.compute.manager [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Detaching volume 2c316b2d-328a-4863-8ee7-b216639e40ab
Apr 12 09:39:26 user nova-compute[71482]: INFO nova.virt.block_device [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Attempting to driver detach volume 2c316b2d-328a-4863-8ee7-b216639e40ab from mountpoint /dev/vdb
Apr 12 09:39:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Attempting to detach device vdb from instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:39:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:39:26 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:39:26 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:39:26 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:39:26 user nova-compute[71482]:   <serial>2c316b2d-328a-4863-8ee7-b216639e40ab</serial>
Apr 12 09:39:26 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:39:26 user nova-compute[71482]: </disk>
Apr 12 09:39:26 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:39:26 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Successfully detached device vdb from instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 from the persistent domain config.
Apr 12 09:39:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:39:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:39:26 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:39:26 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:39:26 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:39:26 user nova-compute[71482]:   <serial>2c316b2d-328a-4863-8ee7-b216639e40ab</serial>
Apr 12 09:39:26 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:39:26 user nova-compute[71482]: </disk>
Apr 12 09:39:26 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:39:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681292367.2894025, d4bf54e3-c4cd-4f1e-a0c3-eec827238982 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:39:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Successfully detached device vdb from instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982 from the live domain config.
Apr 12 09:39:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEQSlpYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:39:27 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a6dd39-c53e-4124-bc90-832f7469cf73]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:39:27 user nova-compute[71482]: No targets found.
Apr 12 09:39:27 user nova-compute[71482]: iSNS:
Apr 12 09:39:27 user nova-compute[71482]: No targets found.
Apr 12 09:39:27 user nova-compute[71482]: STATIC:
Apr 12 09:39:27 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a
Apr 12 09:39:27 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:39:27 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:39:27 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab
Apr 12 09:39:27 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:39:27 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:39:27 user nova-compute[71482]: FIRMWARE:
Apr 12 09:39:27 user nova-compute[71482]: No targets found.
Apr 12 09:39:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:39:27 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:39:27 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d9e6ba-6992-4180-b60d-0b1df0921557]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74f6336-042e-42b2-908a-7a2bd0fd5891]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:39:27 user nova-compute[71482]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab (non-flash)
Apr 12 09:39:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:39:27 user nova-compute[71482]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab (non-flash)
Apr 12 09:39:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f930858b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65b1e4b-a893-4cba-acb6-d50eded25b83]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf28b643-9de4-49c1-bbcd-a235325af1a0]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3287b1a-1093-4edb-a61e-eaf3c5217450]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b2ded9-30bb-4a93-a5a0-8bdfe9f929b1]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4afbf36-9f39-4b0f-8c41-f8e405182e8c]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2dcf0b-296f-4420-afb5-c11f89f10d68]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab, portal: 172.16.0.220,3260]
Apr 12 09:39:27 user nova-compute[71482]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab, portal: 172.16.0.220,3260] successful.
Apr 12 09:39:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f066e0ee-5cc2-4681-ae3c-adfed6580d4f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] <== disconnect_volume: return (307ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:39:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG nova.objects.instance [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'flavor' on Instance uuid d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-99655b9d-eb9b-43b7-a9c2-27bfbd7ecbab tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.761s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.633s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:28 user nova-compute[71482]: INFO nova.compute.manager [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Terminating instance
Apr 12 09:39:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received event network-vif-unplugged-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] No waiting events found dispatching network-vif-unplugged-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-3d9258f7-daff-46b9-8f2e-665f5b8e70d4 req-f53526d3-c097-4e60-91f1-6937a33e65e8 service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received event network-vif-unplugged-8c15ba29-fa31-4056-a248-840557a7a18a for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:39:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Instance destroyed successfully.
Apr 12 09:39:29 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'resources' on Instance uuid d4bf54e3-c4cd-4f1e-a0c3-eec827238982 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:37:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2125995582',display_name='tempest-VolumesSnapshotTestJSON-instance-2125995582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2125995582',id=39,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:37:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b7b1c70322c4f31a30e0294291aa165',ramdisk_id='',reservation_id='r-c1xbuxng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1644949007',owner_user_name='tempest-VolumesSnapshotTestJSON-1644949007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:37:23Z,user_data=None,user_id='7b2402ddb2264bc19341580cc719c706',uuid=d4bf54e3-c4cd-4f1e-a0c3-eec827238982,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converting VIF {"id": "8c15ba29-fa31-4056-a248-840557a7a18a", "address": "fa:16:3e:34:49:d0", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c15ba29-fa", "ovs_interfaceid": "8c15ba29-fa31-4056-a248-840557a7a18a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c15ba29-fa31-4056-a248-840557a7a18a,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c15ba29-fa') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_vif [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c15ba29-fa31-4056-a248-840557a7a18a,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c15ba29-fa') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c15ba29-fa, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:29 user nova-compute[71482]: INFO os_vif [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=8c15ba29-fa31-4056-a248-840557a7a18a,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c15ba29-fa')
Apr 12 09:39:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qEQSlpYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:39:29 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34bfb2f-0262-4bfd-ad93-bbc9d63473ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:39:29 user nova-compute[71482]: No targets found.
Apr 12 09:39:29 user nova-compute[71482]: iSNS:
Apr 12 09:39:29 user nova-compute[71482]: No targets found.
Apr 12 09:39:29 user nova-compute[71482]: STATIC:
Apr 12 09:39:29 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a
Apr 12 09:39:29 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:39:29 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:39:29 user nova-compute[71482]: FIRMWARE:
Apr 12 09:39:29 user nova-compute[71482]: No targets found.
Apr 12 09:39:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:39:29 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:39:29 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c316b2d-328a-4863-8ee7-b216639e40ab', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d37d9-4091-451e-9e74-f6fe7020afd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2120b6d6-8319-4e6f-a67f-ff85b760fa9e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:39:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:39:29 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9308542950>, {}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Disconnecting from: [] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.063s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] <== disconnect_volume: return (65ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:39:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Deleting instance files /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982_del
Apr 12 09:39:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Deletion of /opt/stack/data/nova/instances/d4bf54e3-c4cd-4f1e-a0c3-eec827238982_del complete
Apr 12 09:39:29 user nova-compute[71482]: INFO nova.compute.manager [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 12 09:39:29 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:39:29 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:39:30 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Took 0.85 seconds to deallocate network for instance.
Apr 12 09:39:30 user nova-compute[71482]: WARNING nova.volume.cinder [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Attachment 1698e681-5979-4be8-aa00-34e2810e8761 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1698e681-5979-4be8-aa00-34e2810e8761. (HTTP 404) (Request-ID: req-d9403452-61ed-454d-b2ce-4e09543f10ba)
Apr 12 09:39:30 user nova-compute[71482]: INFO nova.compute.manager [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Took 0.03 seconds to detach 1 volumes for instance.
Apr 12 09:39:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:30 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Deleted allocations for instance d4bf54e3-c4cd-4f1e-a0c3-eec827238982
Apr 12 09:39:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8e00c0c8-3d45-4f8d-b25d-f493badb20a5 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.121s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received event network-vif-plugged-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] Acquiring lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] Lock "d4bf54e3-c4cd-4f1e-a0c3-eec827238982-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:39:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] No waiting events found dispatching network-vif-plugged-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:39:30 user nova-compute[71482]: WARNING nova.compute.manager [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received unexpected event network-vif-plugged-8c15ba29-fa31-4056-a248-840557a7a18a for instance with vm_state deleted and task_state None.
Apr 12 09:39:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-c881426a-34cf-4a7e-989c-3dd6f3016226 req-92ca6ec8-7dc0-48b5-b725-e6ee0936c67f service nova] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Received event network-vif-deleted-8c15ba29-fa31-4056-a248-840557a7a18a {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:39:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:39:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:44 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292369.1949885, d4bf54e3-c4cd-4f1e-a0c3-eec827238982 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:39:44 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] VM Stopped (Lifecycle Event)
Apr 12 09:39:44 user nova-compute[71482]: DEBUG nova.compute.manager [None req-e4c4e7df-553e-4654-a186-dfb2db3bdeeb None None] [instance: d4bf54e3-c4cd-4f1e-a0c3-eec827238982] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:39:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:39:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:39:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:39:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:39:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:39:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:40:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:40:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:40:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:40:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Updating instance_info_cache with network_info: [{"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:40:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:40:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:40:04 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:08 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:08 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:15 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:40:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:40:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:40:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:40:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:40:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:40:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:40:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:40:22 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:40:22 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=26.311046600341797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a42b12e5-5e85-4206-866f-42294318f0b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:40:22 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:40:23 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:40:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:40:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:40:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:40:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:25 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:40:27 user nova-compute[71482]: INFO nova.compute.claims [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Claim successful on node user
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.209s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:40:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:40:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Creating image(s)
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "/opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "/opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "/opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG nova.policy [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b2402ddb2264bc19341580cc719c706', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b7b1c70322c4f31a30e0294291aa165', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk 1073741824" returned: 0 in 0.055s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Cannot resize image /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG nova.objects.instance [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'migration_context' on Instance uuid d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Ensure instance console log exists: /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:28 user nova-compute[71482]: DEBUG nova.network.neutron [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Successfully created port: 54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received event network-changed-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Refreshing instance network info cache due to event network-changed-725c2a1c-abed-48f3-8fe7-f724a7552bca. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] Acquiring lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] Acquired lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Refreshing network info cache for port 725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Successfully updated port: 54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquired lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received event network-changed-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Refreshing instance network info cache due to event network-changed-54dab028-fc6f-489b-80ea-dfe05c140cd2. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] Acquiring lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Updated VIF entry in instance network info cache for port 725c2a1c-abed-48f3-8fe7-f724a7552bca. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Updating instance_info_cache with network_info: [{"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-ce2beec9-7220-41ab-8311-afe674e16035 req-6a2bea3f-30e0-4845-9d85-6136a4440226 service nova] Releasing lock "refresh_cache-a42b12e5-5e85-4206-866f-42294318f0b0" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.network.neutron [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updating instance_info_cache with network_info: [{"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Releasing lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Instance network_info: |[{"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] Acquired lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.network.neutron [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Refreshing network info cache for port 54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Start _get_guest_xml network_info=[{"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:40:29 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:40:29 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:40:29 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1287954701',display_name='tempest-VolumesSnapshotTestJSON-instance-1287954701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1287954701',id=41,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b7b1c70322c4f31a30e0294291aa165',ramdisk_id='',reservation_id='r-udymjb03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1644949007',owner_user_name='tempest-VolumesSnapshotTestJSON-1644949007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:40:28Z,user_data=None,user_id='7b2402ddb2264bc19341580cc719c706',uuid=d563bdb7-9e57-43f3-8e33-a957e9aeda4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converting VIF {"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:b3:4b,bridge_name='br-int',has_traffic_filtering=True,id=54dab028-fc6f-489b-80ea-dfe05c140cd2,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54dab028-fc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.objects.instance [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'pci_devices' on Instance uuid d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:40:30 user nova-compute[71482]:   <uuid>d563bdb7-9e57-43f3-8e33-a957e9aeda4b</uuid>
Apr 12 09:40:30 user nova-compute[71482]:   <name>instance-00000029</name>
Apr 12 09:40:30 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:40:30 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:40:30 user nova-compute[71482]:   <metadata>
Apr 12 09:40:30 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:40:30 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:40:30 user nova-compute[71482]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1287954701</nova:name>
Apr 12 09:40:30 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:40:29</nova:creationTime>
Apr 12 09:40:30 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:40:30 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:40:30 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:40:30 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:40:30 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:40:30 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:40:30 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:40:30 user nova-compute[71482]:       <nova:owner>
Apr 12 09:40:30 user nova-compute[71482]:         <nova:user uuid="7b2402ddb2264bc19341580cc719c706">tempest-VolumesSnapshotTestJSON-1644949007-project-member</nova:user>
Apr 12 09:40:30 user nova-compute[71482]:         <nova:project uuid="5b7b1c70322c4f31a30e0294291aa165">tempest-VolumesSnapshotTestJSON-1644949007</nova:project>
Apr 12 09:40:30 user nova-compute[71482]:       </nova:owner>
Apr 12 09:40:30 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:40:30 user nova-compute[71482]:       <nova:ports>
Apr 12 09:40:30 user nova-compute[71482]:         <nova:port uuid="54dab028-fc6f-489b-80ea-dfe05c140cd2">
Apr 12 09:40:30 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 12 09:40:30 user nova-compute[71482]:         </nova:port>
Apr 12 09:40:30 user nova-compute[71482]:       </nova:ports>
Apr 12 09:40:30 user nova-compute[71482]:     </nova:instance>
Apr 12 09:40:30 user nova-compute[71482]:   </metadata>
Apr 12 09:40:30 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:40:30 user nova-compute[71482]:     <system>
Apr 12 09:40:30 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:40:30 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:40:30 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:40:30 user nova-compute[71482]:       <entry name="serial">d563bdb7-9e57-43f3-8e33-a957e9aeda4b</entry>
Apr 12 09:40:30 user nova-compute[71482]:       <entry name="uuid">d563bdb7-9e57-43f3-8e33-a957e9aeda4b</entry>
Apr 12 09:40:30 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:40:30 user nova-compute[71482]:     </system>
Apr 12 09:40:30 user nova-compute[71482]:   </sysinfo>
Apr 12 09:40:30 user nova-compute[71482]:   <os>
Apr 12 09:40:30 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:40:30 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:40:30 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:40:30 user nova-compute[71482]:   </os>
Apr 12 09:40:30 user nova-compute[71482]:   <features>
Apr 12 09:40:30 user nova-compute[71482]:     <acpi/>
Apr 12 09:40:30 user nova-compute[71482]:     <apic/>
Apr 12 09:40:30 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:40:30 user nova-compute[71482]:   </features>
Apr 12 09:40:30 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:40:30 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:40:30 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:40:30 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:40:30 user nova-compute[71482]:   </clock>
Apr 12 09:40:30 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:40:30 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:40:30 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:40:30 user nova-compute[71482]:   </cpu>
Apr 12 09:40:30 user nova-compute[71482]:   <devices>
Apr 12 09:40:30 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:40:30 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:40:30 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk"/>
Apr 12 09:40:30 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:40:30 user nova-compute[71482]:     </disk>
Apr 12 09:40:30 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:40:30 user nova-compute[71482]:       <mac address="fa:16:3e:f3:b3:4b"/>
Apr 12 09:40:30 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:40:30 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:40:30 user nova-compute[71482]:       <target dev="tap54dab028-fc"/>
Apr 12 09:40:30 user nova-compute[71482]:     </interface>
Apr 12 09:40:30 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:40:30 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/console.log" append="off"/>
Apr 12 09:40:30 user nova-compute[71482]:     </serial>
Apr 12 09:40:30 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:40:30 user nova-compute[71482]:     <video>
Apr 12 09:40:30 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:40:30 user nova-compute[71482]:     </video>
Apr 12 09:40:30 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:40:30 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:40:30 user nova-compute[71482]:     </rng>
Apr 12 09:40:30 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:40:30 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:40:30 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:40:30 user nova-compute[71482]:     </memballoon>
Apr 12 09:40:30 user nova-compute[71482]:   </devices>
Apr 12 09:40:30 user nova-compute[71482]: </domain>
Apr 12 09:40:30 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1287954701',display_name='tempest-VolumesSnapshotTestJSON-instance-1287954701',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1287954701',id=41,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5b7b1c70322c4f31a30e0294291aa165',ramdisk_id='',reservation_id='r-udymjb03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1644949007',owner_user_name='tempest-VolumesSnapshotTestJSON-1644949007-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:40:28Z,user_data=None,user_id='7b2402ddb2264bc19341580cc719c706',uuid=d563bdb7-9e57-43f3-8e33-a957e9aeda4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converting VIF {"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:b3:4b,bridge_name='br-int',has_traffic_filtering=True,id=54dab028-fc6f-489b-80ea-dfe05c140cd2,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54dab028-fc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG os_vif [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:b3:4b,bridge_name='br-int',has_traffic_filtering=True,id=54dab028-fc6f-489b-80ea-dfe05c140cd2,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54dab028-fc') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54dab028-fc, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54dab028-fc, col_values=(('external_ids', {'iface-id': '54dab028-fc6f-489b-80ea-dfe05c140cd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:b3:4b', 'vm-uuid': 'd563bdb7-9e57-43f3-8e33-a957e9aeda4b'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:30 user nova-compute[71482]: INFO os_vif [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:b3:4b,bridge_name='br-int',has_traffic_filtering=True,id=54dab028-fc6f-489b-80ea-dfe05c140cd2,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54dab028-fc')
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No VIF found with MAC fa:16:3e:f3:b3:4b, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "a42b12e5-5e85-4206-866f-42294318f0b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a42b12e5-5e85-4206-866f-42294318f0b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:30 user nova-compute[71482]: INFO nova.compute.manager [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Terminating instance
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.network.neutron [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updated VIF entry in instance network info cache for port 54dab028-fc6f-489b-80ea-dfe05c140cd2. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.network.neutron [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updating instance_info_cache with network_info: [{"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-490d1ede-c052-4580-9222-e79f49ba7fa9 req-7a861833-5ce8-4fa2-afed-7c51c3f6a4ca service nova] Releasing lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received event network-vif-unplugged-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] Acquiring lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] No waiting events found dispatching network-vif-unplugged-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:40:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-4a03225d-6e88-4a54-9a6d-d5167eba000f req-a260b677-25b4-4b69-b8f9-77c43fc30a18 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received event network-vif-unplugged-725c2a1c-abed-48f3-8fe7-f724a7552bca for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:40:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Instance destroyed successfully.
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'resources' on Instance uuid a42b12e5-5e85-4206-866f-42294318f0b0 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1150635585',display_name='tempest-TestVolumeBootPattern-server-1150635585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1150635585',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw==',key_name='tempest-TestVolumeBootPattern-390353875',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:38:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-a2et90sj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:38:49Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=a42b12e5-5e85-4206-866f-42294318f0b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "address": "fa:16:3e:b3:65:b8", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725c2a1c-ab", "ovs_interfaceid": "725c2a1c-abed-48f3-8fe7-f724a7552bca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:65:b8,bridge_name='br-int',has_traffic_filtering=True,id=725c2a1c-abed-48f3-8fe7-f724a7552bca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725c2a1c-ab') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_vif [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:65:b8,bridge_name='br-int',has_traffic_filtering=True,id=725c2a1c-abed-48f3-8fe7-f724a7552bca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725c2a1c-ab') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap725c2a1c-ab, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:31 user nova-compute[71482]: INFO os_vif [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:65:b8,bridge_name='br-int',has_traffic_filtering=True,id=725c2a1c-abed-48f3-8fe7-f724a7552bca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725c2a1c-ab')
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMUyezpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:40:31 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b2de70-9005-4f94-811f-0d4d6e741185]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:40:31 user nova-compute[71482]: No targets found.
Apr 12 09:40:31 user nova-compute[71482]: iSNS:
Apr 12 09:40:31 user nova-compute[71482]: No targets found.
Apr 12 09:40:31 user nova-compute[71482]: STATIC:
Apr 12 09:40:31 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a
Apr 12 09:40:31 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:40:31 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:40:31 user nova-compute[71482]: FIRMWARE:
Apr 12 09:40:31 user nova-compute[71482]: No targets found.
Apr 12 09:40:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:40:31 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:40:31 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df6e10c-f7fe-41a5-b89e-4be0c2c7520d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[afca1bf4-9e5b-4222-b42b-d62c7b07aa82]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:40:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:40:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f930853edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d70b08-8eb5-4312-9f15-f619dbb4ece1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d9ff8-15ee-403e-b7ec-959329d74074]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[169c8e6b-cd2d-44e9-bfa6-7f700168238d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec340ed-f796-4120-9aa7-ccebb79a7648]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf4eec3-97e1-432b-84ef-24b9d9479769]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a5ff7a-0058-4d45-8c9f-e508b307fa2f]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260]
Apr 12 09:40:31 user nova-compute[71482]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260] successful.
Apr 12 09:40:31 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2a2abc-92f8-42ac-898d-f8218cfd608c]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== disconnect_volume: return (313ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:40:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Deleting instance files /opt/stack/data/nova/instances/a42b12e5-5e85-4206-866f-42294318f0b0_del
Apr 12 09:40:31 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Deletion of /opt/stack/data/nova/instances/a42b12e5-5e85-4206-866f-42294318f0b0_del complete
Apr 12 09:40:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:31 user nova-compute[71482]: INFO nova.compute.manager [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Took 1.48 seconds to destroy the instance on the hypervisor.
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.compute.manager [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received event network-vif-plugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:31 user nova-compute[71482]: DEBUG nova.compute.manager [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] No waiting events found dispatching network-vif-plugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:40:31 user nova-compute[71482]: WARNING nova.compute.manager [req-eba70559-e560-4929-be58-bb93fcb687ae req-11973d1d-ccae-4acc-8af6-493fa4e003eb service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received unexpected event network-vif-plugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance with vm_state building and task_state spawning.
Apr 12 09:40:32 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:40:32 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Took 0.72 seconds to deallocate network for instance.
Apr 12 09:40:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-ff0aaaf0-5cb7-4867-ae65-90721223d352 req-eaa6a662-9cbf-4f40-8f90-91ca8b355dc7 service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received event network-vif-deleted-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:40:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received event network-vif-plugged-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:40:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] Acquiring lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] Lock "a42b12e5-5e85-4206-866f-42294318f0b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] No waiting events found dispatching network-vif-plugged-725c2a1c-abed-48f3-8fe7-f724a7552bca {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:40:32 user nova-compute[71482]: WARNING nova.compute.manager [req-7d3f41c6-2fa7-4083-a64c-59588b1c5494 req-f1e2bdd8-c95a-489f-8d52-91eff075396c service nova] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Received unexpected event network-vif-plugged-725c2a1c-abed-48f3-8fe7-f724a7552bca for instance with vm_state active and task_state deleting.
Apr 12 09:40:33 user nova-compute[71482]: INFO nova.compute.manager [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Took 0.87 seconds to detach 1 volumes for instance.
Apr 12 09:40:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:33 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:40:33 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:40:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:33 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Deleted allocations for instance a42b12e5-5e85-4206-866f-42294318f0b0
Apr 12 09:40:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a6324e4d-cb78-400b-b13e-697f99901b08 tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a42b12e5-5e85-4206-866f-42294318f0b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.505s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received event network-vif-plugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.compute.manager [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] No waiting events found dispatching network-vif-plugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:40:34 user nova-compute[71482]: WARNING nova.compute.manager [req-b4a1ad15-0404-49de-b98f-27d1397dbead req-42d2d57d-6cdf-4601-a5c4-27b825ae6363 service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received unexpected event network-vif-plugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance with vm_state building and task_state spawning.
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292434.1298738, d563bdb7-9e57-43f3-8e33-a957e9aeda4b => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:40:34 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] VM Resumed (Lifecycle Event)
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:40:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Instance spawned successfully.
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:40:34 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292434.1336532, d563bdb7-9e57-43f3-8e33-a957e9aeda4b => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:40:34 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] VM Started (Lifecycle Event)
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:40:34 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:40:34 user nova-compute[71482]: INFO nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Took 6.41 seconds to spawn the instance on the hypervisor.
Apr 12 09:40:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:40:34 user nova-compute[71482]: INFO nova.compute.manager [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Took 6.92 seconds to build instance.
Apr 12 09:40:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-761804d9-7ae3-4770-bbf3-25b3634ffc9e tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.014s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:40:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:46 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292431.3863244, a42b12e5-5e85-4206-866f-42294318f0b0 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:40:46 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] VM Stopped (Lifecycle Event)
Apr 12 09:40:46 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a1bde984-1c88-4c49-ac76-44c512a60867 None None] [instance: a42b12e5-5e85-4206-866f-42294318f0b0] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:40:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:40:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:40:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updating instance_info_cache with network_info: [{"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:41:00 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:41:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:41:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:06 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:41:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:41:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:41:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:41:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:16 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:41:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:41:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:41:21 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:41:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:41:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:41:21 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:41:21 user nova-compute[71482]: INFO nova.compute.claims [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Claim successful on node user
Apr 12 09:41:22 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:41:22 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:41:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:41:22 user nova-compute[71482]: INFO nova.virt.block_device [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Booting with volume d1ab1273-9a1f-422c-8d8c-85ec688d5b9a at /dev/vda
Apr 12 09:41:22 user nova-compute[71482]: DEBUG nova.policy [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG os_brick.utils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de76007-3c80-4dd5-b9ca-22d218cbd5a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4027be9f-43c4-486e-a732-945213cd2b5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a89eb2-8c0e-4d37-b4e7-9736479200c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[37868a0b-4cb7-4cee-9998-c1964f911b27]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:41:22 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:41:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16c2bb5-fd91-409e-bf44-b1b09b10d1bd]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG os_brick.utils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:41:22 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updating existing volume attachment record: 23b41a71-35b1-46ac-bbd0-2bc324607684 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:41:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Successfully created port: 183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Successfully updated port: 183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquired lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received event network-changed-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG nova.compute.manager [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Refreshing instance network info cache due to event network-changed-183ee788-84e9-448a-a5d8-6c6d95b9d250. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] Acquiring lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:24 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:41:24 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:41:24 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=26.282535552978516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:41:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.network.neutron [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updating instance_info_cache with network_info: [{"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Releasing lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Instance network_info: |[{"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] Acquired lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:41:25 user nova-compute[71482]: DEBUG nova.network.neutron [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Refreshing network info cache for port 183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:41:26 user nova-compute[71482]: DEBUG nova.network.neutron [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updated VIF entry in instance network info cache for port 183ee788-84e9-448a-a5d8-6c6d95b9d250. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:41:26 user nova-compute[71482]: DEBUG nova.network.neutron [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updating instance_info_cache with network_info: [{"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:41:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-46e17922-065f-4692-9b18-1b499b488e0a req-0a193ff3-9da9-49f0-9257-5b5f9f8f014c service nova] Releasing lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:41:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:41:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:41:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:41:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:41:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:41:27 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Creating image(s)
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Ensure instance console log exists: /opt/stack/data/nova/instances/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Start _get_guest_xml network_info=[{"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '23b41a71-35b1-46ac-bbd0-2bc324607684', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMUyezpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'serial': 'd1ab1273-9a1f-422c-8d8c-85ec688d5b9a'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:41:27 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:41:27 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMUyezpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:41:27 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:41:27 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:41:27 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dea239-676b-4a59-ab8e-4ae04588f381]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:41:27 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b2a38d-45b0-4ca5-a925-f9ac7aac67eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a] added
Apr 12 09:41:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c30eaff-8d40-4650-93e9-129f31fdb70e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[033cda71-18cc-4e62-990d-528bd3c1791d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMUyezpN {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TMUyezpN" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f5a4ad-8aa2-4dc0-8cf6-acc8ad4d5618]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TMUyezpN'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb8c1af-a1a9-454a-9174-4a45eada1c89]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf0ff7-2196-4db0-bb57-2aa6c7dc236e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:41:27 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:41:27 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:41:27 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:41:27 user nova-compute[71482]: 
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8037617e-8fef-4b5d-b3e6-ca0d4701709b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260]
Apr 12 09:41:27 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260] successful.
Apr 12 09:41:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f42e49b-b38d-4575-a214-a30d9a8108fb]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb8a195-f3e8-4aae-a0f0-1daa7a401e9c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:41:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:41:27 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2bc32d-4277-4806-bf46-05c181e5cb14]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:41:27 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMUyezpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26662623437663461', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662623437663461', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-273431965',display_name='tempest-TestVolumeBootPattern-server-273431965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-273431965',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw==',key_name='tempest-TestVolumeBootPattern-390353875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-h7lnd0vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:41:22Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=183ee788-84e9-448a-a5d8-6c6d95b9d250,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ee788-84') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.objects.instance [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'pci_devices' on Instance uuid a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:41:28 user nova-compute[71482]:   <uuid>a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae</uuid>
Apr 12 09:41:28 user nova-compute[71482]:   <name>instance-0000002a</name>
Apr 12 09:41:28 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:41:28 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:41:28 user nova-compute[71482]:   <metadata>
Apr 12 09:41:28 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:41:28 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:41:28 user nova-compute[71482]:       <nova:name>tempest-TestVolumeBootPattern-server-273431965</nova:name>
Apr 12 09:41:28 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:41:27</nova:creationTime>
Apr 12 09:41:28 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:41:28 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:41:28 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:41:28 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:41:28 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:41:28 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:41:28 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:41:28 user nova-compute[71482]:       <nova:owner>
Apr 12 09:41:28 user nova-compute[71482]:         <nova:user uuid="4d3fba65a6ff4e73addd3ec6cdbb08cf">tempest-TestVolumeBootPattern-757175647-project-member</nova:user>
Apr 12 09:41:28 user nova-compute[71482]:         <nova:project uuid="1a0437bfee4545949707443636e07b80">tempest-TestVolumeBootPattern-757175647</nova:project>
Apr 12 09:41:28 user nova-compute[71482]:       </nova:owner>
Apr 12 09:41:28 user nova-compute[71482]:       <nova:ports>
Apr 12 09:41:28 user nova-compute[71482]:         <nova:port uuid="183ee788-84e9-448a-a5d8-6c6d95b9d250">
Apr 12 09:41:28 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 12 09:41:28 user nova-compute[71482]:         </nova:port>
Apr 12 09:41:28 user nova-compute[71482]:       </nova:ports>
Apr 12 09:41:28 user nova-compute[71482]:     </nova:instance>
Apr 12 09:41:28 user nova-compute[71482]:   </metadata>
Apr 12 09:41:28 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:41:28 user nova-compute[71482]:     <system>
Apr 12 09:41:28 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:41:28 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:41:28 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:41:28 user nova-compute[71482]:       <entry name="serial">a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae</entry>
Apr 12 09:41:28 user nova-compute[71482]:       <entry name="uuid">a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae</entry>
Apr 12 09:41:28 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:41:28 user nova-compute[71482]:     </system>
Apr 12 09:41:28 user nova-compute[71482]:   </sysinfo>
Apr 12 09:41:28 user nova-compute[71482]:   <os>
Apr 12 09:41:28 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:41:28 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:41:28 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:41:28 user nova-compute[71482]:   </os>
Apr 12 09:41:28 user nova-compute[71482]:   <features>
Apr 12 09:41:28 user nova-compute[71482]:     <acpi/>
Apr 12 09:41:28 user nova-compute[71482]:     <apic/>
Apr 12 09:41:28 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:41:28 user nova-compute[71482]:   </features>
Apr 12 09:41:28 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:41:28 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:41:28 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:41:28 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:41:28 user nova-compute[71482]:   </clock>
Apr 12 09:41:28 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:41:28 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:41:28 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:41:28 user nova-compute[71482]:   </cpu>
Apr 12 09:41:28 user nova-compute[71482]:   <devices>
Apr 12 09:41:28 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:41:28 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:41:28 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:41:28 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:41:28 user nova-compute[71482]:       <serial>d1ab1273-9a1f-422c-8d8c-85ec688d5b9a</serial>
Apr 12 09:41:28 user nova-compute[71482]:     </disk>
Apr 12 09:41:28 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:41:28 user nova-compute[71482]:       <mac address="fa:16:3e:c2:9e:d1"/>
Apr 12 09:41:28 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:41:28 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:41:28 user nova-compute[71482]:       <target dev="tap183ee788-84"/>
Apr 12 09:41:28 user nova-compute[71482]:     </interface>
Apr 12 09:41:28 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:41:28 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae/console.log" append="off"/>
Apr 12 09:41:28 user nova-compute[71482]:     </serial>
Apr 12 09:41:28 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:41:28 user nova-compute[71482]:     <video>
Apr 12 09:41:28 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:41:28 user nova-compute[71482]:     </video>
Apr 12 09:41:28 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:41:28 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:41:28 user nova-compute[71482]:     </rng>
Apr 12 09:41:28 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:41:28 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:41:28 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:41:28 user nova-compute[71482]:     </memballoon>
Apr 12 09:41:28 user nova-compute[71482]:   </devices>
Apr 12 09:41:28 user nova-compute[71482]: </domain>
Apr 12 09:41:28 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-273431965',display_name='tempest-TestVolumeBootPattern-server-273431965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-273431965',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw==',key_name='tempest-TestVolumeBootPattern-390353875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-h7lnd0vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:41:22Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=183ee788-84e9-448a-a5d8-6c6d95b9d250,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ee788-84') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG os_vif [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=183ee788-84e9-448a-a5d8-6c6d95b9d250,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ee788-84') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap183ee788-84, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap183ee788-84, col_values=(('external_ids', {'iface-id': '183ee788-84e9-448a-a5d8-6c6d95b9d250', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:9e:d1', 'vm-uuid': 'a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:28 user nova-compute[71482]: INFO os_vif [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=183ee788-84e9-448a-a5d8-6c6d95b9d250,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ee788-84')
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:41:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No VIF found with MAC fa:16:3e:c2:9e:d1, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:41:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received event network-vif-plugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:41:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] Acquiring lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:41:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:41:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:41:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] No waiting events found dispatching network-vif-plugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:41:30 user nova-compute[71482]: WARNING nova.compute.manager [req-89744504-4a91-4910-b495-139586342d86 req-7edb7f09-28fe-4943-8f70-8a345025be6c service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received unexpected event network-vif-plugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance with vm_state building and task_state spawning.
Apr 12 09:41:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292492.0700252, a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:41:32 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] VM Resumed (Lifecycle Event)
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:41:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Instance spawned successfully.
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:41:32 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292492.0713248, a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:41:32 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] VM Started (Lifecycle Event)
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:41:32 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:41:32 user nova-compute[71482]: INFO nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Took 4.95 seconds to spawn the instance on the hypervisor.
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received event network-vif-plugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] Acquiring lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:41:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] No waiting events found dispatching network-vif-plugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:41:32 user nova-compute[71482]: WARNING nova.compute.manager [req-e0cb0fcc-ab31-4386-8182-9ec3672f7c26 req-bc70aae5-7c74-4f5f-bbfc-65e0c61d79c7 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received unexpected event network-vif-plugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance with vm_state building and task_state spawning.
Apr 12 09:41:32 user nova-compute[71482]: INFO nova.compute.manager [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Took 10.36 seconds to build instance.
Apr 12 09:41:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d2d473d0-3be2-48ef-9d18-6de78db9909b tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.447s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:41:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:41:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updating instance_info_cache with network_info: [{"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-d563bdb7-9e57-43f3-8e33-a957e9aeda4b" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:42:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:42:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:07 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:42:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:42:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:42:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:42:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:42:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:42:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:42:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:42:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:42:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:42:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:42:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:17 user nova-compute[71482]: DEBUG nova.objects.instance [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'flavor' on Instance uuid d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:42:17 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Ignoring supplied device name: /dev/vdb
Apr 12 09:42:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:17 user nova-compute[71482]: INFO nova.compute.manager [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Attaching volume e650ef38-fa8c-4be8-a0bc-e34015660b22 to /dev/vdb
Apr 12 09:42:18 user nova-compute[71482]: DEBUG os_brick.utils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd40f7e2-6204-4775-9cd5-97b731111fcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[619168c6-1430-4eed-a680-af2e1f064354]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0add2c-fec6-48c2-b1bd-d470f364b7ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bcae69-9bff-41e6-8e23-58851091dfc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:42:18 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:42:18 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da9b4ef-c773-4124-be5e-8dc9cf27d334]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG os_brick.utils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updating existing volume attachment record: c3224f09-32c7-4920-adb6-35d289dd7367 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxiJBvGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:42:22 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:42:22 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:42:22 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[242b7220-48de-4430-8274-d7e5860b12c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:42:22 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[748b5108-9d3c-4f35-b440-9cd2cb7a4feb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22] added
Apr 12 09:42:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db55e9c-53bd-4a58-90a9-94f5b6afea67]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[929de9f2-187f-4dd9-9a2e-d7b6f5e0bc96]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxiJBvGK {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxiJBvGK" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea16d62-ca3c-4910-a7e0-88d7735494bc]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxiJBvGK'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[215297a7-5dad-4625-b87e-2fe8cebac1c2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[92208189-4bc0-4439-889c-03d1e51efb0c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:42:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:42:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e5285e-846e-46b9-a471-f3089bbdc7d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22, portal: 172.16.0.220,3260]
Apr 12 09:42:22 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22, portal: 172.16.0.220,3260] successful.
Apr 12 09:42:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6abe3a0-61db-4015-ba00-c482bccdd4ed]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cdf09c-216c-416c-ac9f-834fb5e0d054]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:42:22 user nova-compute[71482]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 (non-flash)
Apr 12 09:42:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:42:22 user nova-compute[71482]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 (non-flash)
Apr 12 09:42:22 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9d92fe-d898-44eb-b8ae-23b92662735f]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:22 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxiJBvGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23530366135343238', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530366135343238', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG nova.objects.instance [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'flavor' on Instance uuid d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:42:23 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:42:23 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:42:23 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:42:23 user nova-compute[71482]:   <serial>e650ef38-fa8c-4be8-a0bc-e34015660b22</serial>
Apr 12 09:42:23 user nova-compute[71482]: </disk>
Apr 12 09:42:23 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:42:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] No VIF found with MAC fa:16:3e:f3:b3:4b, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:42:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-706407f1-0471-40cc-b63e-7ac3d2ac4e43 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.092s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:42:26 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:42:26 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:42:26 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=26.28085708618164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:27 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:42:27 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:42:27 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:42:27 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:42:27 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:42:27 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:42:27 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:42:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:42:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:42:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:42:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:42:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:35 user nova-compute[71482]: INFO nova.compute.manager [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Detaching volume e650ef38-fa8c-4be8-a0bc-e34015660b22
Apr 12 09:42:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:35 user nova-compute[71482]: INFO nova.virt.block_device [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Attempting to driver detach volume e650ef38-fa8c-4be8-a0bc-e34015660b22 from mountpoint /dev/vdb
Apr 12 09:42:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Attempting to detach device vdb from instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:42:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:42:35 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:42:35 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:42:35 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:42:35 user nova-compute[71482]:   <serial>e650ef38-fa8c-4be8-a0bc-e34015660b22</serial>
Apr 12 09:42:35 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:42:35 user nova-compute[71482]: </disk>
Apr 12 09:42:35 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:42:35 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Successfully detached device vdb from instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b from the persistent domain config.
Apr 12 09:42:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:42:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:42:35 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:42:35 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:42:35 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:42:35 user nova-compute[71482]:   <serial>e650ef38-fa8c-4be8-a0bc-e34015660b22</serial>
Apr 12 09:42:35 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:42:35 user nova-compute[71482]: </disk>
Apr 12 09:42:35 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681292556.473976, d563bdb7-9e57-43f3-8e33-a957e9aeda4b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:42:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Successfully detached device vdb from instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b from the live domain config.
Apr 12 09:42:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxiJBvGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:42:36 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[762eab1b-bede-4cd6-85fe-125be35de18a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:42:36 user nova-compute[71482]: No targets found.
Apr 12 09:42:36 user nova-compute[71482]: iSNS:
Apr 12 09:42:36 user nova-compute[71482]: No targets found.
Apr 12 09:42:36 user nova-compute[71482]: STATIC:
Apr 12 09:42:36 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22
Apr 12 09:42:36 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:42:36 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:42:36 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a
Apr 12 09:42:36 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:42:36 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:42:36 user nova-compute[71482]: FIRMWARE:
Apr 12 09:42:36 user nova-compute[71482]: No targets found.
Apr 12 09:42:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:42:36 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:42:36 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef741abb-5e15-44e1-ba7c-43ca5d0b38d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e412b99c-96f4-48e4-ac88-f741b2e75c8c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:42:36 user nova-compute[71482]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 (non-flash)
Apr 12 09:42:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:42:36 user nova-compute[71482]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 (non-flash)
Apr 12 09:42:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f930858a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36d6232-634f-4a01-b6f4-5b76c9c105d6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d17b75-6a6f-452e-849a-baa622cf2e19]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e20e98a-6cf8-460b-ac20-fc4ebce81b64]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.084s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c251a5-9761-4463-a1c5-6f52ec79fe92]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a721c77-6e0b-483e-a2d6-54d7bef50228]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b7a493-b2aa-40ac-8fca-7593e0c97299]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22, portal: 172.16.0.220,3260]
Apr 12 09:42:36 user nova-compute[71482]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22, portal: 172.16.0.220,3260] successful.
Apr 12 09:42:36 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b22ef6-2701-44b0-9ef8-a40b1666463e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] <== disconnect_volume: return (322ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:42:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG nova.objects.instance [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'flavor' on Instance uuid d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-9bacc829-8afc-453b-9b5f-cef0dcee4123 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.939s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.827s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:37 user nova-compute[71482]: INFO nova.compute.manager [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Terminating instance
Apr 12 09:42:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received event network-vif-unplugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] No waiting events found dispatching network-vif-unplugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:42:37 user nova-compute[71482]: DEBUG nova.compute.manager [req-683bf0b0-deb6-419f-ab68-8f58111d2f13 req-dca1b604-b89e-482d-9335-93b8797d6423 service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received event network-vif-unplugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Instance destroyed successfully.
Apr 12 09:42:38 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lazy-loading 'resources' on Instance uuid d563bdb7-9e57-43f3-8e33-a957e9aeda4b {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:40:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1287954701',display_name='tempest-VolumesSnapshotTestJSON-instance-1287954701',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1287954701',id=41,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:40:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5b7b1c70322c4f31a30e0294291aa165',ramdisk_id='',reservation_id='r-udymjb03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1644949007',owner_user_name='tempest-VolumesSnapshotTestJSON-1644949007-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:40:34Z,user_data=None,user_id='7b2402ddb2264bc19341580cc719c706',uuid=d563bdb7-9e57-43f3-8e33-a957e9aeda4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converting VIF {"id": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "address": "fa:16:3e:f3:b3:4b", "network": {"id": "48a4a967-0639-4505-a467-85bc73b75a4c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1749615444-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "5b7b1c70322c4f31a30e0294291aa165", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54dab028-fc", "ovs_interfaceid": "54dab028-fc6f-489b-80ea-dfe05c140cd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:b3:4b,bridge_name='br-int',has_traffic_filtering=True,id=54dab028-fc6f-489b-80ea-dfe05c140cd2,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54dab028-fc') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_vif [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:b3:4b,bridge_name='br-int',has_traffic_filtering=True,id=54dab028-fc6f-489b-80ea-dfe05c140cd2,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54dab028-fc') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54dab028-fc, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:38 user nova-compute[71482]: INFO os_vif [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:b3:4b,bridge_name='br-int',has_traffic_filtering=True,id=54dab028-fc6f-489b-80ea-dfe05c140cd2,network=Network(48a4a967-0639-4505-a467-85bc73b75a4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54dab028-fc')
Apr 12 09:42:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxiJBvGK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:42:38 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7728b8a5-a567-4104-abaa-db665b5805fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:42:38 user nova-compute[71482]: No targets found.
Apr 12 09:42:38 user nova-compute[71482]: iSNS:
Apr 12 09:42:38 user nova-compute[71482]: No targets found.
Apr 12 09:42:38 user nova-compute[71482]: STATIC:
Apr 12 09:42:38 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a
Apr 12 09:42:38 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:42:38 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:42:38 user nova-compute[71482]: FIRMWARE:
Apr 12 09:42:38 user nova-compute[71482]: No targets found.
Apr 12 09:42:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:42:38 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:42:38 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e650ef38-fa8c-4be8-a0bc-e34015660b22', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bd14b9-ed95-42b5-b855-37efd8fea64f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f69522-3d80-44b6-b6f0-6ca5a5d12266]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:42:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:42:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f93085428c0>, {}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Disconnecting from: [] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.064s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] <== disconnect_volume: return (66ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:42:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Deleting instance files /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b_del
Apr 12 09:42:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Deletion of /opt/stack/data/nova/instances/d563bdb7-9e57-43f3-8e33-a957e9aeda4b_del complete
Apr 12 09:42:38 user nova-compute[71482]: INFO nova.compute.manager [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 09:42:38 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:42:38 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:42:39 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Took 0.48 seconds to deallocate network for instance.
Apr 12 09:42:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received event network-vif-deleted-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:42:39 user nova-compute[71482]: INFO nova.compute.manager [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Neutron deleted interface 54dab028-fc6f-489b-80ea-dfe05c140cd2; detaching it from the instance and deleting it from the info cache
Apr 12 09:42:39 user nova-compute[71482]: DEBUG nova.network.neutron [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:42:39 user nova-compute[71482]: WARNING nova.volume.cinder [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Attachment c3224f09-32c7-4920-adb6-35d289dd7367 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c3224f09-32c7-4920-adb6-35d289dd7367. (HTTP 404) (Request-ID: req-b3d03089-42dc-4957-9f96-0f49f72e9706)
Apr 12 09:42:39 user nova-compute[71482]: INFO nova.compute.manager [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Took 0.02 seconds to detach 1 volumes for instance.
Apr 12 09:42:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-e178299d-4921-4a4c-89be-3ccdfa2c4e31 req-0a7c9c38-674f-48c5-84fc-8e284571e93a service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Detach interface failed, port_id=54dab028-fc6f-489b-80ea-dfe05c140cd2, reason: Instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:39 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Deleted allocations for instance d563bdb7-9e57-43f3-8e33-a957e9aeda4b
Apr 12 09:42:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f77191ec-ee63-4679-9149-ebc02a9ff1b6 tempest-VolumesSnapshotTestJSON-1644949007 tempest-VolumesSnapshotTestJSON-1644949007-project-member] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.738s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received event network-vif-plugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] Acquiring lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] Lock "d563bdb7-9e57-43f3-8e33-a957e9aeda4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:42:39 user nova-compute[71482]: DEBUG nova.compute.manager [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] No waiting events found dispatching network-vif-plugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:42:39 user nova-compute[71482]: WARNING nova.compute.manager [req-fba971d4-477d-4ddb-977f-6c4fbaeadfc6 req-9a5a22e6-c71c-4f25-87c6-17c10fe0b28f service nova] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Received unexpected event network-vif-plugged-54dab028-fc6f-489b-80ea-dfe05c140cd2 for instance with vm_state deleted and task_state None.
Apr 12 09:42:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:53 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292558.4004261, d563bdb7-9e57-43f3-8e33-a957e9aeda4b => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:42:53 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] VM Stopped (Lifecycle Event)
Apr 12 09:42:53 user nova-compute[71482]: DEBUG nova.compute.manager [None req-df9249db-ba63-4d25-994d-dda96b2bae4a None None] [instance: d563bdb7-9e57-43f3-8e33-a957e9aeda4b] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:42:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:42:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:42:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:42:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:42:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:42:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:42:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:42:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:01 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:43:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:43:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:43:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:43:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updating instance_info_cache with network_info: [{"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:43:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:43:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:43:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:07 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:43:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:12 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received event network-changed-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Refreshing instance network info cache due to event network-changed-183ee788-84e9-448a-a5d8-6c6d95b9d250. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] Acquiring lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] Acquired lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG nova.network.neutron [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Refreshing network info cache for port 183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:43:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updated VIF entry in instance network info cache for port 183ee788-84e9-448a-a5d8-6c6d95b9d250. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:43:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updating instance_info_cache with network_info: [{"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:43:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-32f6fbee-3880-49d9-9a7b-8269dad34c17 req-c48bce73-d75f-41b1-9af0-ae72ca9550b3 service nova] Releasing lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:43:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:43:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "9d302843-fdb1-4b87-865d-17c7627c86a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:43:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:43:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:43:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:43:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:43:19 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:43:19 user nova-compute[71482]: INFO nova.compute.claims [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Claim successful on node user
Apr 12 09:43:19 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:43:19 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:43:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:43:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG nova.network.neutron [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:43:20 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:43:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:43:20 user nova-compute[71482]: INFO nova.virt.block_device [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Booting with volume 1063b66e-b23f-4a63-83e2-631935335e70 at /dev/vda
Apr 12 09:43:20 user nova-compute[71482]: DEBUG nova.policy [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d3fba65a6ff4e73addd3ec6cdbb08cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a0437bfee4545949707443636e07b80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG os_brick.utils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[908b2bba-7cd1-4d09-9520-76527efcc931]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc7502f-9b13-4615-8789-745a6fe697e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8635ac1-c74e-4b45-87f9-539bb40587bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c59557a-e2f2-4c03-ac7b-e9ea4252cb2d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:43:20 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:43:20 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9123070f-b057-492b-8e47-102b0d37c486]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG os_brick.utils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updating existing volume attachment record: 9ec95071-9d8d-4e74-92ce-99ed79227958 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:43:20 user nova-compute[71482]: DEBUG nova.network.neutron [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Successfully created port: 007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Successfully updated port: 007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquired lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received event network-changed-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG nova.compute.manager [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Refreshing instance network info cache due to event network-changed-007e55cd-ac21-45a1-8067-7c1d254589ca. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] Acquiring lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG nova.network.neutron [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updating instance_info_cache with network_info: [{"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Releasing lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Instance network_info: |[{"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] Acquired lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:43:21 user nova-compute[71482]: DEBUG nova.network.neutron [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Refreshing network info cache for port 007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:43:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updated VIF entry in instance network info cache for port 007e55cd-ac21-45a1-8067-7c1d254589ca. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:43:22 user nova-compute[71482]: DEBUG nova.network.neutron [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updating instance_info_cache with network_info: [{"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:43:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8290ba67-bcb7-4f4f-b39e-b0a80a50003d req-7c63af40-5c3f-4bca-9e6e-98f4a474a70f service nova] Releasing lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:43:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:43:24 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Creating image(s)
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Ensure instance console log exists: /opt/stack/data/nova/instances/9d302843-fdb1-4b87-865d-17c7627c86a9/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Start _get_guest_xml network_info=[{"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9ec95071-9d8d-4e74-92ce-99ed79227958', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZStwgarT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9d302843-fdb1-4b87-865d-17c7627c86a9', 'attached_at': '', 'detached_at': '', 'volume_id': '1063b66e-b23f-4a63-83e2-631935335e70', 'serial': '1063b66e-b23f-4a63-83e2-631935335e70'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:43:24 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:43:24 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZStwgarT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:43:24 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:43:24 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:43:24 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77447c-cf95-4f78-aa39-24cb7b9754e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:43:24 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[53356a0d-cee7-449e-a42c-29f90adf0f31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70] added
Apr 12 09:43:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf941dd-7f06-4143-9724-f86dd1e7939d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a3646-ee92-41b0-a671-bae5b18daf27]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZStwgarT {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZStwgarT" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53a8bc3-275c-458a-9d84-6d6e0c36e44e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZStwgarT'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d148dc8-393b-4e8b-95e5-c5f3e71f9b3b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e67841c-5bf1-4818-9f60-81a8b29c3b4f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:43:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:43:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9304ecd3-a6d8-4d05-bcf3-3266087fe2cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70, portal: 172.16.0.220,3260]
Apr 12 09:43:24 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70, portal: 172.16.0.220,3260] successful.
Apr 12 09:43:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[caed0952-04d8-4107-b183-96a74ca8a911]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa303bfe-ec7a-4a73-b66c-9c397537de0d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:43:24 user nova-compute[71482]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 (non-flash)
Apr 12 09:43:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:43:24 user nova-compute[71482]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 (non-flash)
Apr 12 09:43:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:43:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:43:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:43:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:43:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c14df35-d12f-40b7-84b9-ab4b5371ed04]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:43:25 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:43:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZStwgarT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26533643733396538', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533643733396538', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1913845244',display_name='tempest-TestVolumeBootPattern-server-1913845244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1913845244',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw==',key_name='tempest-TestVolumeBootPattern-390353875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-s7t80wmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:43:20Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=9d302843-fdb1-4b87-865d-17c7627c86a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a5:13,bridge_name='br-int',has_traffic_filtering=True,id=007e55cd-ac21-45a1-8067-7c1d254589ca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007e55cd-ac') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.objects.instance [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'pci_devices' on Instance uuid 9d302843-fdb1-4b87-865d-17c7627c86a9 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:43:26 user nova-compute[71482]:   <uuid>9d302843-fdb1-4b87-865d-17c7627c86a9</uuid>
Apr 12 09:43:26 user nova-compute[71482]:   <name>instance-0000002b</name>
Apr 12 09:43:26 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:43:26 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:43:26 user nova-compute[71482]:   <metadata>
Apr 12 09:43:26 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:43:26 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:43:26 user nova-compute[71482]:       <nova:name>tempest-TestVolumeBootPattern-server-1913845244</nova:name>
Apr 12 09:43:26 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:43:24</nova:creationTime>
Apr 12 09:43:26 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:43:26 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:43:26 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:43:26 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:43:26 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:43:26 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:43:26 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:43:26 user nova-compute[71482]:       <nova:owner>
Apr 12 09:43:26 user nova-compute[71482]:         <nova:user uuid="4d3fba65a6ff4e73addd3ec6cdbb08cf">tempest-TestVolumeBootPattern-757175647-project-member</nova:user>
Apr 12 09:43:26 user nova-compute[71482]:         <nova:project uuid="1a0437bfee4545949707443636e07b80">tempest-TestVolumeBootPattern-757175647</nova:project>
Apr 12 09:43:26 user nova-compute[71482]:       </nova:owner>
Apr 12 09:43:26 user nova-compute[71482]:       <nova:ports>
Apr 12 09:43:26 user nova-compute[71482]:         <nova:port uuid="007e55cd-ac21-45a1-8067-7c1d254589ca">
Apr 12 09:43:26 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 12 09:43:26 user nova-compute[71482]:         </nova:port>
Apr 12 09:43:26 user nova-compute[71482]:       </nova:ports>
Apr 12 09:43:26 user nova-compute[71482]:     </nova:instance>
Apr 12 09:43:26 user nova-compute[71482]:   </metadata>
Apr 12 09:43:26 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:43:26 user nova-compute[71482]:     <system>
Apr 12 09:43:26 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:43:26 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:43:26 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:43:26 user nova-compute[71482]:       <entry name="serial">9d302843-fdb1-4b87-865d-17c7627c86a9</entry>
Apr 12 09:43:26 user nova-compute[71482]:       <entry name="uuid">9d302843-fdb1-4b87-865d-17c7627c86a9</entry>
Apr 12 09:43:26 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:43:26 user nova-compute[71482]:     </system>
Apr 12 09:43:26 user nova-compute[71482]:   </sysinfo>
Apr 12 09:43:26 user nova-compute[71482]:   <os>
Apr 12 09:43:26 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:43:26 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:43:26 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:43:26 user nova-compute[71482]:   </os>
Apr 12 09:43:26 user nova-compute[71482]:   <features>
Apr 12 09:43:26 user nova-compute[71482]:     <acpi/>
Apr 12 09:43:26 user nova-compute[71482]:     <apic/>
Apr 12 09:43:26 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:43:26 user nova-compute[71482]:   </features>
Apr 12 09:43:26 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:43:26 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:43:26 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:43:26 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:43:26 user nova-compute[71482]:   </clock>
Apr 12 09:43:26 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:43:26 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:43:26 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:43:26 user nova-compute[71482]:   </cpu>
Apr 12 09:43:26 user nova-compute[71482]:   <devices>
Apr 12 09:43:26 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:43:26 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:43:26 user nova-compute[71482]:       <source dev="/dev/sdc"/>
Apr 12 09:43:26 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:43:26 user nova-compute[71482]:       <serial>1063b66e-b23f-4a63-83e2-631935335e70</serial>
Apr 12 09:43:26 user nova-compute[71482]:     </disk>
Apr 12 09:43:26 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:43:26 user nova-compute[71482]:       <mac address="fa:16:3e:a2:a5:13"/>
Apr 12 09:43:26 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:43:26 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:43:26 user nova-compute[71482]:       <target dev="tap007e55cd-ac"/>
Apr 12 09:43:26 user nova-compute[71482]:     </interface>
Apr 12 09:43:26 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:43:26 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/9d302843-fdb1-4b87-865d-17c7627c86a9/console.log" append="off"/>
Apr 12 09:43:26 user nova-compute[71482]:     </serial>
Apr 12 09:43:26 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:43:26 user nova-compute[71482]:     <video>
Apr 12 09:43:26 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:43:26 user nova-compute[71482]:     </video>
Apr 12 09:43:26 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:43:26 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:43:26 user nova-compute[71482]:     </rng>
Apr 12 09:43:26 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:43:26 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:43:26 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:43:26 user nova-compute[71482]:     </memballoon>
Apr 12 09:43:26 user nova-compute[71482]:   </devices>
Apr 12 09:43:26 user nova-compute[71482]: </domain>
Apr 12 09:43:26 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1913845244',display_name='tempest-TestVolumeBootPattern-server-1913845244',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1913845244',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw==',key_name='tempest-TestVolumeBootPattern-390353875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-s7t80wmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:43:20Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=9d302843-fdb1-4b87-865d-17c7627c86a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a5:13,bridge_name='br-int',has_traffic_filtering=True,id=007e55cd-ac21-45a1-8067-7c1d254589ca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007e55cd-ac') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG os_vif [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a5:13,bridge_name='br-int',has_traffic_filtering=True,id=007e55cd-ac21-45a1-8067-7c1d254589ca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007e55cd-ac') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap007e55cd-ac, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap007e55cd-ac, col_values=(('external_ids', {'iface-id': '007e55cd-ac21-45a1-8067-7c1d254589ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:a5:13', 'vm-uuid': '9d302843-fdb1-4b87-865d-17c7627c86a9'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:26 user nova-compute[71482]: INFO os_vif [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:a5:13,bridge_name='br-int',has_traffic_filtering=True,id=007e55cd-ac21-45a1-8067-7c1d254589ca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007e55cd-ac')
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:43:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] No VIF found with MAC fa:16:3e:a2:a5:13, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG nova.compute.manager [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received event network-vif-plugged-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] Acquiring lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG nova.compute.manager [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] No waiting events found dispatching network-vif-plugged-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:43:27 user nova-compute[71482]: WARNING nova.compute.manager [req-9a6ee29e-93ef-49fc-b304-875d17580149 req-4289497b-fc2c-4c35-81d7-f271e557d0ac service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received unexpected event network-vif-plugged-007e55cd-ac21-45a1-8067-7c1d254589ca for instance with vm_state building and task_state spawning.
Apr 12 09:43:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:43:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:43:28 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:43:28 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:43:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=26.29747772216797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9d302843-fdb1-4b87-865d-17c7627c86a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:43:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292609.661307, 9d302843-fdb1-4b87-865d-17c7627c86a9 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:43:29 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] VM Resumed (Lifecycle Event)
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:43:29 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Instance spawned successfully.
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:43:29 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292609.662677, 9d302843-fdb1-4b87-865d-17c7627c86a9 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:43:29 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] VM Started (Lifecycle Event)
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received event network-vif-plugged-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] Acquiring lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.compute.manager [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] No waiting events found dispatching network-vif-plugged-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:43:29 user nova-compute[71482]: WARNING nova.compute.manager [req-da1f4d4c-5f35-42ea-ab8e-045b5fbd0457 req-576d1923-c98f-47c6-8f73-8120016369d3 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received unexpected event network-vif-plugged-007e55cd-ac21-45a1-8067-7c1d254589ca for instance with vm_state building and task_state spawning.
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:43:29 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:43:29 user nova-compute[71482]: INFO nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Took 5.18 seconds to spawn the instance on the hypervisor.
Apr 12 09:43:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:43:29 user nova-compute[71482]: INFO nova.compute.manager [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Took 10.12 seconds to build instance.
Apr 12 09:43:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-469f1576-ed25-4d0a-aab6-c1cbd4080b5f tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.211s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:43:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:43:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:03 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:44:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:44:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:44:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:44:03 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:44:03 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:44:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updating instance_info_cache with network_info: [{"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:44:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:44:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:44:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:08 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:12 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:44:13 user nova-compute[71482]: INFO nova.compute.claims [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Claim successful on node user
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.network.neutron [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:44:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.policy [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:44:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Creating image(s)
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "/opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "/opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "e78501620e6a271799d2fe3af9ed365fbe59eaba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "e78501620e6a271799d2fe3af9ed365fbe59eaba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba.part --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.virt.images [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] bf78848c-38c3-43e7-b908-42b091dbbdbd was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:44:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba.part /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.network.neutron [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Successfully created port: 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba.part /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba.converted" returned: 0 in 0.156s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba.converted --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "e78501620e6a271799d2fe3af9ed365fbe59eaba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.812s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "e78501620e6a271799d2fe3af9ed365fbe59eaba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "e78501620e6a271799d2fe3af9ed365fbe59eaba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba --force-share --output=json" returned: 0 in 0.147s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba,backing_fmt=raw /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba,backing_fmt=raw /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk 1073741824" returned: 0 in 0.047s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "e78501620e6a271799d2fe3af9ed365fbe59eaba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.202s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.network.neutron [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Successfully updated port: 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquired lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.network.neutron [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing instance network info cache due to event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] Acquiring lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Cannot resize image /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.objects.instance [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'migration_context' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.network.neutron [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Ensure instance console log exists: /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.network.neutron [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Releasing lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Instance network_info: |[{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] Acquired lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Start _get_guest_xml network_info=[{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:44:10Z,direct_url=<?>,disk_format='qcow2',id=bf78848c-38c3-43e7-b908-42b091dbbdbd,min_disk=0,min_ram=0,name='tempest-scenario-img--845680882',owner='044d0193867a407ba80522df35f5d667',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:44:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'bf78848c-38c3-43e7-b908-42b091dbbdbd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:44:15 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:44:15 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:44:10Z,direct_url=<?>,disk_format='qcow2',id=bf78848c-38c3-43e7-b908-42b091dbbdbd,min_disk=0,min_ram=0,name='tempest-scenario-img--845680882',owner='044d0193867a407ba80522df35f5d667',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:44:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404599988',display_name='tempest-TestMinimumBasicScenario-server-1404599988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404599988',id=44,image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFOqIN1Pf1NB/QjxUMaNgH6RoPt5npz9d2f3DihQHSx4VSWqvA79iJxXvGaIRpuSkyfaxajHPH7p7S1YgzHrmkTia3ryFD9Hgdem+xd8sFXeghoii97Du2AgQJb6GqD2w==',key_name='tempest-TestMinimumBasicScenario-677654037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='044d0193867a407ba80522df35f5d667',ramdisk_id='',reservation_id='r-lf4zsa2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-935210424',owner_user_name='tempest-TestMinimumBasicScenario-935210424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:44:13Z,user_data=None,user_id='345fff9dd4ce4b74bc87ff29db51e162',uuid=b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converting VIF {"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.objects.instance [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'pci_devices' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:44:15 user nova-compute[71482]:   <uuid>b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67</uuid>
Apr 12 09:44:15 user nova-compute[71482]:   <name>instance-0000002c</name>
Apr 12 09:44:15 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:44:15 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:44:15 user nova-compute[71482]:   <metadata>
Apr 12 09:44:15 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:44:15 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:44:15 user nova-compute[71482]:       <nova:name>tempest-TestMinimumBasicScenario-server-1404599988</nova:name>
Apr 12 09:44:15 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:44:15</nova:creationTime>
Apr 12 09:44:15 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:44:15 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:44:15 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:44:15 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:44:15 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:44:15 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:44:15 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:44:15 user nova-compute[71482]:       <nova:owner>
Apr 12 09:44:15 user nova-compute[71482]:         <nova:user uuid="345fff9dd4ce4b74bc87ff29db51e162">tempest-TestMinimumBasicScenario-935210424-project-member</nova:user>
Apr 12 09:44:15 user nova-compute[71482]:         <nova:project uuid="044d0193867a407ba80522df35f5d667">tempest-TestMinimumBasicScenario-935210424</nova:project>
Apr 12 09:44:15 user nova-compute[71482]:       </nova:owner>
Apr 12 09:44:15 user nova-compute[71482]:       <nova:root type="image" uuid="bf78848c-38c3-43e7-b908-42b091dbbdbd"/>
Apr 12 09:44:15 user nova-compute[71482]:       <nova:ports>
Apr 12 09:44:15 user nova-compute[71482]:         <nova:port uuid="62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d">
Apr 12 09:44:15 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 09:44:15 user nova-compute[71482]:         </nova:port>
Apr 12 09:44:15 user nova-compute[71482]:       </nova:ports>
Apr 12 09:44:15 user nova-compute[71482]:     </nova:instance>
Apr 12 09:44:15 user nova-compute[71482]:   </metadata>
Apr 12 09:44:15 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:44:15 user nova-compute[71482]:     <system>
Apr 12 09:44:15 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:44:15 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:44:15 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:44:15 user nova-compute[71482]:       <entry name="serial">b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67</entry>
Apr 12 09:44:15 user nova-compute[71482]:       <entry name="uuid">b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67</entry>
Apr 12 09:44:15 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:44:15 user nova-compute[71482]:     </system>
Apr 12 09:44:15 user nova-compute[71482]:   </sysinfo>
Apr 12 09:44:15 user nova-compute[71482]:   <os>
Apr 12 09:44:15 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:44:15 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:44:15 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:44:15 user nova-compute[71482]:   </os>
Apr 12 09:44:15 user nova-compute[71482]:   <features>
Apr 12 09:44:15 user nova-compute[71482]:     <acpi/>
Apr 12 09:44:15 user nova-compute[71482]:     <apic/>
Apr 12 09:44:15 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:44:15 user nova-compute[71482]:   </features>
Apr 12 09:44:15 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:44:15 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:44:15 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:44:15 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:44:15 user nova-compute[71482]:   </clock>
Apr 12 09:44:15 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:44:15 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:44:15 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:44:15 user nova-compute[71482]:   </cpu>
Apr 12 09:44:15 user nova-compute[71482]:   <devices>
Apr 12 09:44:15 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:44:15 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:44:15 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk"/>
Apr 12 09:44:15 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:44:15 user nova-compute[71482]:     </disk>
Apr 12 09:44:15 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:44:15 user nova-compute[71482]:       <mac address="fa:16:3e:f0:e0:ec"/>
Apr 12 09:44:15 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:44:15 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:44:15 user nova-compute[71482]:       <target dev="tap62eb8dd5-7e"/>
Apr 12 09:44:15 user nova-compute[71482]:     </interface>
Apr 12 09:44:15 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:44:15 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/console.log" append="off"/>
Apr 12 09:44:15 user nova-compute[71482]:     </serial>
Apr 12 09:44:15 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:44:15 user nova-compute[71482]:     <video>
Apr 12 09:44:15 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:44:15 user nova-compute[71482]:     </video>
Apr 12 09:44:15 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:44:15 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:44:15 user nova-compute[71482]:     </rng>
Apr 12 09:44:15 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:44:15 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:44:15 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:44:15 user nova-compute[71482]:     </memballoon>
Apr 12 09:44:15 user nova-compute[71482]:   </devices>
Apr 12 09:44:15 user nova-compute[71482]: </domain>
Apr 12 09:44:15 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404599988',display_name='tempest-TestMinimumBasicScenario-server-1404599988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404599988',id=44,image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFOqIN1Pf1NB/QjxUMaNgH6RoPt5npz9d2f3DihQHSx4VSWqvA79iJxXvGaIRpuSkyfaxajHPH7p7S1YgzHrmkTia3ryFD9Hgdem+xd8sFXeghoii97Du2AgQJb6GqD2w==',key_name='tempest-TestMinimumBasicScenario-677654037',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='044d0193867a407ba80522df35f5d667',ramdisk_id='',reservation_id='r-lf4zsa2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-935210424',owner_user_name='tempest-TestMinimumBasicScenario-935210424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:44:13Z,user_data=None,user_id='345fff9dd4ce4b74bc87ff29db51e162',uuid=b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converting VIF {"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG os_vif [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62eb8dd5-7e, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62eb8dd5-7e, col_values=(('external_ids', {'iface-id': '62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:e0:ec', 'vm-uuid': 'b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:15 user nova-compute[71482]: INFO os_vif [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e')
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No VIF found with MAC fa:16:3e:f0:e0:ec, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updated VIF entry in instance network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:44:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-cfb342bd-4dfb-4803-8a55-75dc7c08cb5e req-8f7cc228-cf24-4f6e-9a6f-88ad22b66555 service nova] Releasing lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:44:16 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:16 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:44:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] No waiting events found dispatching network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:44:17 user nova-compute[71482]: WARNING nova.compute.manager [req-5d8962cd-d9ce-47c3-b0ff-69370da05f78 req-0b04fde5-4d49-4ad5-8517-5ae8daa5c388 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received unexpected event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance with vm_state building and task_state spawning.
Apr 12 09:44:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292659.2592664, b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:44:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] VM Resumed (Lifecycle Event)
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:44:19 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Instance spawned successfully.
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:44:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292659.2612925, b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:44:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] VM Started (Lifecycle Event)
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:44:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:44:19 user nova-compute[71482]: INFO nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Took 5.90 seconds to spawn the instance on the hypervisor.
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:44:19 user nova-compute[71482]: INFO nova.compute.manager [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Took 6.47 seconds to build instance.
Apr 12 09:44:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-351e5c00-9d72-4f1b-8540-de08ddc6a9fd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.555s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.compute.manager [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:19 user nova-compute[71482]: DEBUG nova.compute.manager [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] No waiting events found dispatching network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:44:19 user nova-compute[71482]: WARNING nova.compute.manager [req-8fd64f4b-2708-4e5d-bae6-3c817b561336 req-b26e20aa-121e-43a4-b62f-57cb9c4d5786 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received unexpected event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance with vm_state active and task_state None.
Apr 12 09:44:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:25 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:28 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:44:28 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8639MB free_disk=26.247032165527344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 9d302843-fdb1-4b87-865d-17c7627c86a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=896MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:44:28 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:44:29 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:44:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:44:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Verify base images {{(pid=71482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Image id bf78848c-38c3-43e7-b908-42b091dbbdbd yields fingerprint e78501620e6a271799d2fe3af9ed365fbe59eaba {{(pid=71482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] image bf78848c-38c3-43e7-b908-42b091dbbdbd at (/opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba): checking
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] image bf78848c-38c3-43e7-b908-42b091dbbdbd at (/opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba): image is in use {{(pid=71482) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] 9d302843-fdb1-4b87-865d-17c7627c86a9 is a valid instance name {{(pid=71482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae is a valid instance name {{(pid=71482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 is a valid instance name {{(pid=71482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 has a disk file {{(pid=71482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 is backed by e78501620e6a271799d2fe3af9ed365fbe59eaba {{(pid=71482) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Apr 12 09:44:38 user nova-compute[71482]: WARNING nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0
Apr 12 09:44:38 user nova-compute[71482]: WARNING nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a
Apr 12 09:44:38 user nova-compute[71482]: WARNING nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f
Apr 12 09:44:38 user nova-compute[71482]: WARNING nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8
Apr 12 09:44:38 user nova-compute[71482]: WARNING nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8
Apr 12 09:44:38 user nova-compute[71482]: WARNING nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609
Apr 12 09:44:38 user nova-compute[71482]: WARNING nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f
Apr 12 09:44:38 user nova-compute[71482]: WARNING nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Active base files: /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Removable base files: /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0 /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8 /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8 /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8e188faea5a45dc056d3c888b57f1eb2533270c0
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5d8e5d0f030415416aa1d4b321dced2a79807b8a
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/054e20d370dda696fc4a3f4f0d8e57188a726d9f
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/915f731fd6975e8bbfda78390efd1d200d4e9ee8
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/90e5c494e0f11193c0dab11ea3c53ab68aa3c8f8
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9113e5bfa02931a53739ad35d534f6aede6cf31f
Apr 12 09:44:38 user nova-compute[71482]: INFO nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9e1a18b1b27dbee040866b9884156aae6173e57c
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Verification complete {{(pid=71482) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Verify swap images {{(pid=71482) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.imagecache [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Verify ephemeral images {{(pid=71482) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 12 09:44:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:40 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:44:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:44:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:44:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:44:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:44:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:44:55 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:02 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:45:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:45:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:45:02 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:45:02 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updating instance_info_cache with network_info: [{"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:45:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:45:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:45:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received event network-changed-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:45:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Refreshing instance network info cache due to event network-changed-007e55cd-ac21-45a1-8067-7c1d254589ca. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:45:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] Acquiring lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:45:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] Acquired lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:45:11 user nova-compute[71482]: DEBUG nova.network.neutron [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Refreshing network info cache for port 007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:45:11 user nova-compute[71482]: DEBUG nova.network.neutron [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updated VIF entry in instance network info cache for port 007e55cd-ac21-45a1-8067-7c1d254589ca. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:45:11 user nova-compute[71482]: DEBUG nova.network.neutron [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updating instance_info_cache with network_info: [{"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:45:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-94fd7eee-7f48-4e0e-898d-598159981f6f req-91a5ac2e-f489-4d7c-aa10-fba1b2d14c45 service nova] Releasing lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:45:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received event network-changed-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:45:12 user nova-compute[71482]: DEBUG nova.compute.manager [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Refreshing instance network info cache due to event network-changed-007e55cd-ac21-45a1-8067-7c1d254589ca. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:45:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] Acquiring lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:45:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] Acquired lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:45:12 user nova-compute[71482]: DEBUG nova.network.neutron [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Refreshing network info cache for port 007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "9d302843-fdb1-4b87-865d-17c7627c86a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:45:13 user nova-compute[71482]: INFO nova.compute.manager [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Terminating instance
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received event network-vif-unplugged-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] Acquiring lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] No waiting events found dispatching network-vif-unplugged-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-9529bcf1-25c8-4509-9c07-b086f40b5151 req-1558e5ab-8932-4d49-b3e7-559d0cba7163 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received event network-vif-unplugged-007e55cd-ac21-45a1-8067-7c1d254589ca for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.network.neutron [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updated VIF entry in instance network info cache for port 007e55cd-ac21-45a1-8067-7c1d254589ca. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.network.neutron [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updating instance_info_cache with network_info: [{"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f9843404-083a-499b-88ba-f822cbfd079d req-6f44d316-08dd-4517-b260-920f146af0e7 service nova] Releasing lock "refresh_cache-9d302843-fdb1-4b87-865d-17c7627c86a9" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Instance destroyed successfully.
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.objects.instance [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'resources' on Instance uuid 9d302843-fdb1-4b87-865d-17c7627c86a9 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:43:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1913845244',display_name='tempest-TestVolumeBootPattern-server-1913845244',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1913845244',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw==',key_name='tempest-TestVolumeBootPattern-390353875',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:43:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-s7t80wmo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:43:30Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=9d302843-fdb1-4b87-865d-17c7627c86a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "007e55cd-ac21-45a1-8067-7c1d254589ca", "address": "fa:16:3e:a2:a5:13", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007e55cd-ac", "ovs_interfaceid": "007e55cd-ac21-45a1-8067-7c1d254589ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a5:13,bridge_name='br-int',has_traffic_filtering=True,id=007e55cd-ac21-45a1-8067-7c1d254589ca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007e55cd-ac') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_vif [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a5:13,bridge_name='br-int',has_traffic_filtering=True,id=007e55cd-ac21-45a1-8067-7c1d254589ca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007e55cd-ac') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap007e55cd-ac, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:45:13 user nova-compute[71482]: INFO os_vif [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:a5:13,bridge_name='br-int',has_traffic_filtering=True,id=007e55cd-ac21-45a1-8067-7c1d254589ca,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007e55cd-ac')
Apr 12 09:45:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZStwgarT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:45:13 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7365b9f-53a3-4bbf-946c-567a7ad3223c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:45:13 user nova-compute[71482]: No targets found.
Apr 12 09:45:13 user nova-compute[71482]: iSNS:
Apr 12 09:45:13 user nova-compute[71482]: No targets found.
Apr 12 09:45:13 user nova-compute[71482]: STATIC:
Apr 12 09:45:13 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a
Apr 12 09:45:13 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:45:13 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:45:13 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70
Apr 12 09:45:13 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:45:13 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:45:13 user nova-compute[71482]: FIRMWARE:
Apr 12 09:45:13 user nova-compute[71482]: No targets found.
Apr 12 09:45:13 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:45:13 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:45:13 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf4b104-7406-4f71-89fe-416e2d694798]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0ef59a-dd91-411d-aacc-41e5ded6dcf1]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:45:13 user nova-compute[71482]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 (non-flash)
Apr 12 09:45:13 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:45:13 user nova-compute[71482]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 (non-flash)
Apr 12 09:45:13 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c25f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b5dcdf-13b6-4473-995c-ef9e036b014d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f8dd94-a6b2-47a1-9ea4-770eb4fd2cff]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d0a797-f941-4f13-9569-839d3259799a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:13 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[580bc941-cf1a-4a37-a14c-212726deaf07]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26533643733396538', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_34da22ff', '/dev/disk/by-id/scsi-1SCST_BIO34da22ff-e3d739e8feb646c1') {{(pid=82392) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f235ad5-574c-4d00-972c-de4ef50b3809]: (4, None) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[531abf50-04a5-403d-a635-00ed5d862f55]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0cc690-df00-4396-b0c6-86ebc2afde75]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70, portal: 172.16.0.220,3260]
Apr 12 09:45:14 user nova-compute[71482]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70, portal: 172.16.0.220,3260] successful.
Apr 12 09:45:14 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1063b66e-b23f-4a63-83e2-631935335e70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e27bda-4560-43f0-9f04-b0e3d787934e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== disconnect_volume: return (305ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:45:14 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Deleting instance files /opt/stack/data/nova/instances/9d302843-fdb1-4b87-865d-17c7627c86a9_del
Apr 12 09:45:14 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Deletion of /opt/stack/data/nova/instances/9d302843-fdb1-4b87-865d-17c7627c86a9_del complete
Apr 12 09:45:14 user nova-compute[71482]: INFO nova.compute.manager [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Took 1.18 seconds to destroy the instance on the hypervisor.
Apr 12 09:45:14 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:45:14 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Took 0.53 seconds to deallocate network for instance.
Apr 12 09:45:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received event network-vif-deleted-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:45:14 user nova-compute[71482]: INFO nova.compute.manager [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Neutron deleted interface 007e55cd-ac21-45a1-8067-7c1d254589ca; detaching it from the instance and deleting it from the info cache
Apr 12 09:45:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:45:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-a4d79fd2-90aa-4eef-9975-6a6750b71f62 req-3ebe60cc-420d-4b55-9861-40181d1c7943 service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Detach interface failed, port_id=007e55cd-ac21-45a1-8067-7c1d254589ca, reason: Instance 9d302843-fdb1-4b87-865d-17c7627c86a9 could not be found. {{(pid=71482) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received event network-vif-plugged-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] Acquiring lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] No waiting events found dispatching network-vif-plugged-007e55cd-ac21-45a1-8067-7c1d254589ca {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:45:15 user nova-compute[71482]: WARNING nova.compute.manager [req-a6f98025-c548-466e-82a9-8f26fe3c6e15 req-5b0762b2-beb7-42ba-ba57-7715e7d1898c service nova] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Received unexpected event network-vif-plugged-007e55cd-ac21-45a1-8067-7c1d254589ca for instance with vm_state active and task_state deleting.
Apr 12 09:45:15 user nova-compute[71482]: INFO nova.compute.manager [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Took 0.88 seconds to detach 1 volumes for instance.
Apr 12 09:45:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:45:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:45:15 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Deleted allocations for instance 9d302843-fdb1-4b87-865d-17c7627c86a9
Apr 12 09:45:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-069f843d-792a-4e76-b266-ec1d4d3b667d tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "9d302843-fdb1-4b87-865d-17c7627c86a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.945s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:45:16 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:16 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:17 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:45:18 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:45:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:19 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:19 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:45:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:45:25 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:25 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:45:26 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292713.7732859, 9d302843-fdb1-4b87-865d-17c7627c86a9 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:45:28 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] VM Stopped (Lifecycle Event)
Apr 12 09:45:28 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:45:28 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:45:28 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=26.226375579833984GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:45:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-5a27d28b-3ce1-4e61-8197-e3e17ac63fe3 None None] [instance: 9d302843-fdb1-4b87-865d-17c7627c86a9] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:45:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:45:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:45:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:45:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:45:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:45:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:45:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:45:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updating instance_info_cache with network_info: [{"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:46:05 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:46:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:06 user nova-compute[71482]: DEBUG nova.objects.instance [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'flavor' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:46:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:06 user nova-compute[71482]: INFO nova.compute.manager [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Attaching volume e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 to /dev/vdb
Apr 12 09:46:07 user nova-compute[71482]: DEBUG os_brick.utils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[362f932a-f3e4-40d3-b772-2c88b8de945a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[62205c49-7cc4-4a28-ab55-9ec4a2ca41c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a34b062-1f64-4314-aeec-578db06ff7f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[db35efb2-c2ee-443f-9b18-28a910f271eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:46:07 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:46:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e66f16-ff97-4f3a-81f3-556f6e1456d3]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG os_brick.utils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:46:07 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating existing volume attachment record: 94721319-5048-41bd-909c-917899a9ae54 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received event network-changed-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Refreshing instance network info cache due to event network-changed-183ee788-84e9-448a-a5d8-6c6d95b9d250. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] Acquiring lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] Acquired lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG nova.network.neutron [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Refreshing network info cache for port 183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:08 user nova-compute[71482]: INFO nova.compute.manager [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Terminating instance
Apr 12 09:46:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received event network-vif-unplugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] Acquiring lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] No waiting events found dispatching network-vif-unplugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:46:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-5ba54695-b9e6-4b1f-96c7-6304aef19ac3 req-d732d1c2-c095-4cb2-a0e1-bb28fca8c14f service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received event network-vif-unplugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updated VIF entry in instance network info cache for port 183ee788-84e9-448a-a5d8-6c6d95b9d250. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updating instance_info_cache with network_info: [{"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-073663b5-1cba-426d-8d33-66374fa1ca17 req-bfbaaa20-faeb-4f99-9e6d-5e7346f35a0d service nova] Releasing lock "refresh_cache-a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:46:09 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Instance destroyed successfully.
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.objects.instance [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lazy-loading 'resources' on Instance uuid a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:41:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-273431965',display_name='tempest-TestVolumeBootPattern-server-273431965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-273431965',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/b5XU99iCI2Re6Dg/nxTM2PNL9YNPtaBAvevGpwcNldxldp2Jhd1tLEY2C2/ilzNvyRq4ZcN5fBW0nGge4D6UafKyGRqikFvQylTAKejRAW763+4lKviPU1b1t8qnVBw==',key_name='tempest-TestVolumeBootPattern-390353875',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1a0437bfee4545949707443636e07b80',ramdisk_id='',reservation_id='r-h7lnd0vz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-757175647',owner_user_name='tempest-TestVolumeBootPattern-757175647-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:41:32Z,user_data=None,user_id='4d3fba65a6ff4e73addd3ec6cdbb08cf',uuid=a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converting VIF {"id": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "address": "fa:16:3e:c2:9e:d1", "network": {"id": "04d87eab-eb0c-4ca0-b654-941b5fb8be90", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1681463568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1a0437bfee4545949707443636e07b80", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183ee788-84", "ovs_interfaceid": "183ee788-84e9-448a-a5d8-6c6d95b9d250", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=183ee788-84e9-448a-a5d8-6c6d95b9d250,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ee788-84') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_vif [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=183ee788-84e9-448a-a5d8-6c6d95b9d250,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ee788-84') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap183ee788-84, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:46:09 user nova-compute[71482]: INFO os_vif [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=183ee788-84e9-448a-a5d8-6c6d95b9d250,network=Network(04d87eab-eb0c-4ca0-b654-941b5fb8be90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183ee788-84')
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TMUyezpN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:46:09 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd9f524-fe44-4164-ac62-425ac48fb35b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:46:09 user nova-compute[71482]: No targets found.
Apr 12 09:46:09 user nova-compute[71482]: iSNS:
Apr 12 09:46:09 user nova-compute[71482]: No targets found.
Apr 12 09:46:09 user nova-compute[71482]: STATIC:
Apr 12 09:46:09 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a
Apr 12 09:46:09 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:46:09 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:46:09 user nova-compute[71482]: FIRMWARE:
Apr 12 09:46:09 user nova-compute[71482]: No targets found.
Apr 12 09:46:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:46:09 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:46:09 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6f210a-f9da-4d49-b3c6-8eef17409921]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5436a7-8e81-4d35-953e-734b8259a824]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:46:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a (non-flash)
Apr 12 09:46:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c1648b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca0d08-022e-4502-a54e-714f39129402]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f419e6e-0234-44bd-91dd-3a41da88b0c4]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf2d77-bc49-404d-b010-dc58fceb12d4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6308a074-5f62-4aab-a302-6a6d0b6de1e6]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26662623437663461', '/dev/disk/by-id/scsi-1SCST_BIO514a31b6-fbb47f4a76f7b0c1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_514a31b6') {{(pid=82392) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7300dceb-7887-4d99-9cc9-cc50b254e075]: (4, None) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad70829b-70cb-4441-afae-3f8465e7bb6f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01a5d4e-e833-417d-b7e4-12c15ab293f3]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260]
Apr 12 09:46:09 user nova-compute[71482]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a, portal: 172.16.0.220,3260] successful.
Apr 12 09:46:09 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ab1273-9a1f-422c-8d8c-85ec688d5b9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3815b49f-8451-476d-9e89-fdedf37e28a7]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] <== disconnect_volume: return (288ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:46:09 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Deleting instance files /opt/stack/data/nova/instances/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae_del
Apr 12 09:46:09 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Deletion of /opt/stack/data/nova/instances/a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae_del complete
Apr 12 09:46:09 user nova-compute[71482]: INFO nova.compute.manager [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Took 1.15 seconds to destroy the instance on the hypervisor.
Apr 12 09:46:09 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:46:09 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:46:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:10 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:46:10 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Took 0.50 seconds to deallocate network for instance.
Apr 12 09:46:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-675c7b8a-408e-45e0-be36-5a9aaaf230e6 req-33959885-7ba8-45ed-ba78-8108d2bde56c service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received event network-vif-deleted-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received event network-vif-plugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] Acquiring lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] No waiting events found dispatching network-vif-plugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:46:10 user nova-compute[71482]: WARNING nova.compute.manager [req-74969bfa-504e-4646-924f-2dfed36e41e0 req-e6e48382-c024-421c-940b-d44dcc597aa5 service nova] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Received unexpected event network-vif-plugged-183ee788-84e9-448a-a5d8-6c6d95b9d250 for instance with vm_state active and task_state deleting.
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:11 user nova-compute[71482]: INFO nova.compute.manager [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Took 0.78 seconds to detach 1 volumes for instance.
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:11 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Deleted allocations for instance a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-d9c3811e-72dd-405c-abe0-c732ead93bca tempest-TestVolumeBootPattern-757175647 tempest-TestVolumeBootPattern-757175647-project-member] Lock "a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.788s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYkrCwDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:46:11 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:46:11 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:46:11 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a81a485-fe0f-4659-814c-601f0bf7acc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:46:11 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ea169-2153-4546-accc-c652065bf981]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4] added
Apr 12 09:46:11 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3874ac5f-c1d9-4506-a853-9ef5ee691895]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[184ecf1d-dcc8-4ea1-85d1-ea8db3db0ae4]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYkrCwDf {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYkrCwDf" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e782bab7-73a0-431b-8beb-5efbac348015]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jYkrCwDf'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[228895d2-f6db-4b4e-854a-b1999e62a632]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:11 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[deef46d6-0daa-4deb-8f73-35f0e3899249]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:46:12 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:46:12 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:46:12 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:46:12 user nova-compute[71482]: 
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aae039-87e1-491e-a6f0-0a1816e828f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260]
Apr 12 09:46:12 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260] successful.
Apr 12 09:46:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8cb16-5003-44d3-a7e9-348026c90bd3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6da17a-8371-4ee8-b9dd-f93701589894]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)
Apr 12 09:46:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)
Apr 12 09:46:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62e5e8e-0a47-451a-af18-0731fc14fa24]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:46:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYkrCwDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:46:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:46:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26530396435306330', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:46:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530396435306330', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:46:13 user nova-compute[71482]: DEBUG nova.objects.instance [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'flavor' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:46:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:46:13 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:46:13 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:46:13 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:46:13 user nova-compute[71482]:   <serial>e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4</serial>
Apr 12 09:46:13 user nova-compute[71482]: </disk>
Apr 12 09:46:13 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:46:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:46:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:46:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No VIF found with MAC fa:16:3e:f0:e0:ec, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:46:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-51252cef-65f2-4065-bf14-908ee4d1223f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.770s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:14 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:17 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:18 user nova-compute[71482]: DEBUG nova.compute.manager [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing instance network info cache due to event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:46:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] Acquiring lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:46:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] Acquired lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:46:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:46:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updated VIF entry in instance network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:46:18 user nova-compute[71482]: DEBUG nova.network.neutron [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:46:18 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2be6bf6a-a95f-4e51-80e6-8a6b6954ac67 req-cdb84b43-ba9f-47b7-bf86-dce318c651e2 service nova] Releasing lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:46:19 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:46:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:20 user nova-compute[71482]: DEBUG nova.compute.manager [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing instance network info cache due to event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:46:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] Acquiring lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:46:20 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] Acquired lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:46:20 user nova-compute[71482]: DEBUG nova.network.neutron [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:46:21 user nova-compute[71482]: DEBUG nova.network.neutron [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updated VIF entry in instance network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:46:21 user nova-compute[71482]: DEBUG nova.network.neutron [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:46:21 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-abfedee1-a40e-4c00-beac-65bcf4eff40d req-7659a9f5-0147-4629-863f-53ffa54f5476 service nova] Releasing lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:46:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:22 user nova-compute[71482]: INFO nova.compute.manager [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Rebooting instance
Apr 12 09:46:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:46:22 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquired lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:46:22 user nova-compute[71482]: DEBUG nova.network.neutron [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG nova.network.neutron [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Releasing lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG nova.compute.manager [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-unplugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:23 user nova-compute[71482]: DEBUG nova.compute.manager [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] No waiting events found dispatching network-vif-unplugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:46:23 user nova-compute[71482]: WARNING nova.compute.manager [req-2c5ea447-7265-46c4-b659-873b8998cd45 req-2448ec59-4969-48a8-a231-c72d8a19e4c4 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received unexpected event network-vif-unplugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance with vm_state active and task_state reboot_started_hard.
Apr 12 09:46:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292769.3616748, a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:46:24 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] VM Stopped (Lifecycle Event)
Apr 12 09:46:24 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Instance destroyed successfully.
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.objects.instance [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'resources' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404599988',display_name='tempest-TestMinimumBasicScenario-server-1404599988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404599988',id=44,image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFOqIN1Pf1NB/QjxUMaNgH6RoPt5npz9d2f3DihQHSx4VSWqvA79iJxXvGaIRpuSkyfaxajHPH7p7S1YgzHrmkTia3ryFD9Hgdem+xd8sFXeghoii97Du2AgQJb6GqD2w==',key_name='tempest-TestMinimumBasicScenario-677654037',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:44:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='044d0193867a407ba80522df35f5d667',ramdisk_id='',reservation_id='r-lf4zsa2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-935210424',owner_user_name='tempest-TestMinimumBasicScenario-935210424-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:46:23Z,user_data=None,user_id='345fff9dd4ce4b74bc87ff29db51e162',uuid=b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converting VIF {"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_vif [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-03091a97-d512-4c0d-a85c-b657c3291d7f None None] [instance: a8533dc4-7f4d-44ae-9266-d5c9ad9b1cae] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62eb8dd5-7e, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:46:24 user nova-compute[71482]: INFO os_vif [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e')
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYkrCwDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:46:24 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec166907-9dec-4b26-ab14-58b4b95dfb1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:46:24 user nova-compute[71482]: No targets found.
Apr 12 09:46:24 user nova-compute[71482]: iSNS:
Apr 12 09:46:24 user nova-compute[71482]: No targets found.
Apr 12 09:46:24 user nova-compute[71482]: STATIC:
Apr 12 09:46:24 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4
Apr 12 09:46:24 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:46:24 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:46:24 user nova-compute[71482]: FIRMWARE:
Apr 12 09:46:24 user nova-compute[71482]: No targets found.
Apr 12 09:46:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:46:24 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:46:24 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ade13a5-332b-43f3-9e30-ab69988debaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb1ac56-2cde-4011-932e-7d215dd48787]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)
Apr 12 09:46:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)
Apr 12 09:46:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9308577c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef7acc9-4e9e-498d-8e8e-292c17bc5fef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ab4e49-53b4-49ed-9856-3fe112e2f748]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b9f57b-464b-4d26-8b25-f8c630a4b73b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d9641-2cb1-410c-b42c-fa971cc11769]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1af4ac2-a576-4cbc-9159-105262a52e25]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a602f5f1-ff4e-40f7-b3a6-4335962e1302]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260]
Apr 12 09:46:24 user nova-compute[71482]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260] successful.
Apr 12 09:46:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99a8dce-5790-4036-a997-71585054a542]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] <== disconnect_volume: return (350ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Start _get_guest_xml network_info=[{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf78848c-38c3-43e7-b908-42b091dbbdbd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'bf78848c-38c3-43e7-b908-42b091dbbdbd'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '94721319-5048-41bd-909c-917899a9ae54', 'disk_bus': 'virtio', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYkrCwDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 'serial': 'e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4'}, 'device_type': 'disk', 'boot_index': None, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:46:24 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:46:24 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bf78848c-38c3-43e7-b908-42b091dbbdbd,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.objects.instance [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'vcpu_model' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYkrCwDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:46:24 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:46:24 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:46:24 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7006ce-9de1-4a4c-b5ee-6c8f8ad12b49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:46:24 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9cb859-1a87-4a5d-8f6c-d0a30f76a77e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4] added
Apr 12 09:46:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e772ec45-996e-43bf-b076-3eb0e34056fb]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91b7fa-d4d8-47a9-9875-89bc423ec630]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYkrCwDf {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jYkrCwDf" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9f11e4-61bf-4e26-8885-66a5bcfcc216]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jYkrCwDf'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5d2cff-beda-4b39-a58c-f0d2d90af3a2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c63c274-26a8-4b4d-aff9-ef6b74ad6a00]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:46:25 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:46:25 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:46:25 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:46:25 user nova-compute[71482]: 
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d19240a-bd6f-4d6a-ae9a-0f433b2d82f3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260]
Apr 12 09:46:25 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260] successful.
Apr 12 09:46:25 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[46216de8-fcab-4a62-b512-cf36d4a6a9c0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3446fa64-3541-4b89-abb7-ce9dc7ba921a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)
Apr 12 09:46:25 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)
Apr 12 09:46:25 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f70e7e2-1873-4bee-9b5f-d200e9a774d4]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:46:25 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.compute.manager [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] No waiting events found dispatching network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:46:26 user nova-compute[71482]: WARNING nova.compute.manager [req-3c54a506-d03f-4ff9-9b3e-3031a5a2496f req-6d205d78-3bb0-4af7-a2ef-d457b81a4d0f service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received unexpected event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance with vm_state active and task_state reboot_started_hard.
Apr 12 09:46:26 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYkrCwDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26530396435306330', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530396435306330', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404599988',display_name='tempest-TestMinimumBasicScenario-server-1404599988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404599988',id=44,image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFOqIN1Pf1NB/QjxUMaNgH6RoPt5npz9d2f3DihQHSx4VSWqvA79iJxXvGaIRpuSkyfaxajHPH7p7S1YgzHrmkTia3ryFD9Hgdem+xd8sFXeghoii97Du2AgQJb6GqD2w==',key_name='tempest-TestMinimumBasicScenario-677654037',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:44:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='044d0193867a407ba80522df35f5d667',ramdisk_id='',reservation_id='r-lf4zsa2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-935210424',owner_user_name='tempest-TestMinimumBasicScenario-935210424-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:46:23Z,user_data=None,user_id='345fff9dd4ce4b74bc87ff29db51e162',uuid=b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converting VIF {"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.objects.instance [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'pci_devices' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:46:26 user nova-compute[71482]:   <uuid>b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67</uuid>
Apr 12 09:46:26 user nova-compute[71482]:   <name>instance-0000002c</name>
Apr 12 09:46:26 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:46:26 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:46:26 user nova-compute[71482]:   <metadata>
Apr 12 09:46:26 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:46:26 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:46:26 user nova-compute[71482]:       <nova:name>tempest-TestMinimumBasicScenario-server-1404599988</nova:name>
Apr 12 09:46:26 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:46:24</nova:creationTime>
Apr 12 09:46:26 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:46:26 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:46:26 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:46:26 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:46:26 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:46:26 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:46:26 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:46:26 user nova-compute[71482]:       <nova:owner>
Apr 12 09:46:26 user nova-compute[71482]:         <nova:user uuid="345fff9dd4ce4b74bc87ff29db51e162">tempest-TestMinimumBasicScenario-935210424-project-member</nova:user>
Apr 12 09:46:26 user nova-compute[71482]:         <nova:project uuid="044d0193867a407ba80522df35f5d667">tempest-TestMinimumBasicScenario-935210424</nova:project>
Apr 12 09:46:26 user nova-compute[71482]:       </nova:owner>
Apr 12 09:46:26 user nova-compute[71482]:       <nova:root type="image" uuid="bf78848c-38c3-43e7-b908-42b091dbbdbd"/>
Apr 12 09:46:26 user nova-compute[71482]:       <nova:ports>
Apr 12 09:46:26 user nova-compute[71482]:         <nova:port uuid="62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d">
Apr 12 09:46:26 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 09:46:26 user nova-compute[71482]:         </nova:port>
Apr 12 09:46:26 user nova-compute[71482]:       </nova:ports>
Apr 12 09:46:26 user nova-compute[71482]:     </nova:instance>
Apr 12 09:46:26 user nova-compute[71482]:   </metadata>
Apr 12 09:46:26 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:46:26 user nova-compute[71482]:     <system>
Apr 12 09:46:26 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:46:26 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:46:26 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:46:26 user nova-compute[71482]:       <entry name="serial">b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67</entry>
Apr 12 09:46:26 user nova-compute[71482]:       <entry name="uuid">b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67</entry>
Apr 12 09:46:26 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:46:26 user nova-compute[71482]:     </system>
Apr 12 09:46:26 user nova-compute[71482]:   </sysinfo>
Apr 12 09:46:26 user nova-compute[71482]:   <os>
Apr 12 09:46:26 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:46:26 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:46:26 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:46:26 user nova-compute[71482]:   </os>
Apr 12 09:46:26 user nova-compute[71482]:   <features>
Apr 12 09:46:26 user nova-compute[71482]:     <acpi/>
Apr 12 09:46:26 user nova-compute[71482]:     <apic/>
Apr 12 09:46:26 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:46:26 user nova-compute[71482]:   </features>
Apr 12 09:46:26 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:46:26 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:46:26 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:46:26 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:46:26 user nova-compute[71482]:   </clock>
Apr 12 09:46:26 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:46:26 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:46:26 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:46:26 user nova-compute[71482]:   </cpu>
Apr 12 09:46:26 user nova-compute[71482]:   <devices>
Apr 12 09:46:26 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:46:26 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:46:26 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk"/>
Apr 12 09:46:26 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:46:26 user nova-compute[71482]:     </disk>
Apr 12 09:46:26 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:46:26 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:46:26 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:46:26 user nova-compute[71482]:       <target dev="vdb" bus="virtio"/>
Apr 12 09:46:26 user nova-compute[71482]:       <serial>e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4</serial>
Apr 12 09:46:26 user nova-compute[71482]:     </disk>
Apr 12 09:46:26 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:46:26 user nova-compute[71482]:       <mac address="fa:16:3e:f0:e0:ec"/>
Apr 12 09:46:26 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:46:26 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:46:26 user nova-compute[71482]:       <target dev="tap62eb8dd5-7e"/>
Apr 12 09:46:26 user nova-compute[71482]:     </interface>
Apr 12 09:46:26 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:46:26 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/console.log" append="off"/>
Apr 12 09:46:26 user nova-compute[71482]:     </serial>
Apr 12 09:46:26 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:46:26 user nova-compute[71482]:     <video>
Apr 12 09:46:26 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:46:26 user nova-compute[71482]:     </video>
Apr 12 09:46:26 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:46:26 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:46:26 user nova-compute[71482]:     </rng>
Apr 12 09:46:26 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:46:26 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:46:26 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:46:26 user nova-compute[71482]:     </memballoon>
Apr 12 09:46:26 user nova-compute[71482]:   </devices>
Apr 12 09:46:26 user nova-compute[71482]: </domain>
Apr 12 09:46:26 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.objects.instance [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'trusted_certs' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e78501620e6a271799d2fe3af9ed365fbe59eaba --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Cannot resize image /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.objects.instance [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'migration_context' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404599988',display_name='tempest-TestMinimumBasicScenario-server-1404599988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404599988',id=44,image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFOqIN1Pf1NB/QjxUMaNgH6RoPt5npz9d2f3DihQHSx4VSWqvA79iJxXvGaIRpuSkyfaxajHPH7p7S1YgzHrmkTia3ryFD9Hgdem+xd8sFXeghoii97Du2AgQJb6GqD2w==',key_name='tempest-TestMinimumBasicScenario-677654037',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:44:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='044d0193867a407ba80522df35f5d667',ramdisk_id='',reservation_id='r-lf4zsa2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-935210424',owner_user_name='tempest-TestMinimumBasicScenario-935210424-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:46:23Z,user_data=None,user_id='345fff9dd4ce4b74bc87ff29db51e162',uuid=b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converting VIF {"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG os_vif [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62eb8dd5-7e, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap62eb8dd5-7e, col_values=(('external_ids', {'iface-id': '62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:e0:ec', 'vm-uuid': 'b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:46:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:26 user nova-compute[71482]: INFO os_vif [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e')
Apr 12 09:46:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] No waiting events found dispatching network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:46:28 user nova-compute[71482]: WARNING nova.compute.manager [req-06fdea08-9a48-433f-8402-b76a5ba6f51a req-e6a878d4-5d80-40fc-a23c-6236362722fd service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received unexpected event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance with vm_state active and task_state reboot_started_hard.
Apr 12 09:46:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:46:29 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:46:29 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:46:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=26.208648681640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:46:29 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292790.450705, b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:46:30 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] VM Resumed (Lifecycle Event)
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:46:30 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Instance rebooted successfully.
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] No waiting events found dispatching network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:46:30 user nova-compute[71482]: WARNING nova.compute.manager [req-056bda28-e78c-47a3-9c52-35c8fb7760af req-08a5a209-795c-4e3c-bd9f-0fceb7330972 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received unexpected event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance with vm_state active and task_state reboot_started_hard.
Apr 12 09:46:30 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292790.455233, b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:46:30 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] VM Started (Lifecycle Event)
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:46:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-737ec233-8156-44dc-9ffd-892546936fbc tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.574s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:31 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:46:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:46:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:46:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:46:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:46:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:46:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:46:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:46:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:46:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:46:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:06 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:47:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:47:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:47:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:47:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:07 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:47:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:47:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:47:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:12 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:16 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:20 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:47:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:47:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:47:26 user nova-compute[71482]: INFO nova.compute.claims [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Claim successful on node user
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.network.neutron [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:47:26 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.policy [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21416f43494540f2ad0c2e36edd3dc6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71345b53304d4b99b233f65d427343ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:47:26 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Creating image(s)
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "/opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "/opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "/opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.164s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:47:26 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609,backing_fmt=raw /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk 1073741824" returned: 0 in 0.051s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "d3bb7ad563a7c493b3cb2607092b9b0583019609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d3bb7ad563a7c493b3cb2607092b9b0583019609 --force-share --output=json" returned: 0 in 0.144s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Successfully created port: 0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Cannot resize image /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG nova.objects.instance [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'migration_context' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Ensure instance console log exists: /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Successfully updated port: 0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquired lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:47:27 user nova-compute[71482]: DEBUG nova.network.neutron [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.network.neutron [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received event network-changed-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.compute.manager [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Refreshing instance network info cache due to event network-changed-0db4838f-8419-4187-a457-94bb66310863. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] Acquiring lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.network.neutron [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating instance_info_cache with network_info: [{"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Releasing lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Instance network_info: |[{"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] Acquired lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.network.neutron [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Refreshing network info cache for port 0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Start _get_guest_xml network_info=[{"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '4a835d20-3733-4a8b-bebd-54dfa6135dd6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:47:28 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:47:28 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:05:05Z,direct_url=<?>,disk_format='qcow2',id=4a835d20-3733-4a8b-bebd-54dfa6135dd6,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='108bed9c8ab843b8aa66c29b85b26d87',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:05:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-374987338',display_name='tempest-SnapshotDataIntegrityTests-server-374987338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-374987338',id=45,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjsDJkKscm/m1JO7QZ595+SiXDjpmpWhJ71MxZtaXRHacQPfxCqvNSfAjwlmPltSXx3TKyV4ATsW49g2lUlMNeiZh5xK2SmbT+BEk5RTvMv1raH8TwLLiSnYkURTu3Iaw==',key_name='tempest-SnapshotDataIntegrityTests-2042005072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71345b53304d4b99b233f65d427343ba',ramdisk_id='',reservation_id='r-2009yyvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-977295797',owner_user_name='tempest-SnapshotDataIntegrityTests-977295797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:47:27Z,user_data=None,user_id='21416f43494540f2ad0c2e36edd3dc6f',uuid=98f44ec7-7456-4cb7-9f46-bb19adeaa9b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Converting VIF {"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ea:c1,bridge_name='br-int',has_traffic_filtering=True,id=0db4838f-8419-4187-a457-94bb66310863,network=Network(610b0245-1993-4002-acd5-0cd5ae10b1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db4838f-84') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.objects.instance [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'pci_devices' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:47:28 user nova-compute[71482]:   <uuid>98f44ec7-7456-4cb7-9f46-bb19adeaa9b1</uuid>
Apr 12 09:47:28 user nova-compute[71482]:   <name>instance-0000002d</name>
Apr 12 09:47:28 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:47:28 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:47:28 user nova-compute[71482]:   <metadata>
Apr 12 09:47:28 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:47:28 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:47:28 user nova-compute[71482]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-374987338</nova:name>
Apr 12 09:47:28 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:47:28</nova:creationTime>
Apr 12 09:47:28 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:47:28 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:47:28 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:47:28 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:47:28 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:47:28 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:47:28 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:47:28 user nova-compute[71482]:       <nova:owner>
Apr 12 09:47:28 user nova-compute[71482]:         <nova:user uuid="21416f43494540f2ad0c2e36edd3dc6f">tempest-SnapshotDataIntegrityTests-977295797-project-member</nova:user>
Apr 12 09:47:28 user nova-compute[71482]:         <nova:project uuid="71345b53304d4b99b233f65d427343ba">tempest-SnapshotDataIntegrityTests-977295797</nova:project>
Apr 12 09:47:28 user nova-compute[71482]:       </nova:owner>
Apr 12 09:47:28 user nova-compute[71482]:       <nova:root type="image" uuid="4a835d20-3733-4a8b-bebd-54dfa6135dd6"/>
Apr 12 09:47:28 user nova-compute[71482]:       <nova:ports>
Apr 12 09:47:28 user nova-compute[71482]:         <nova:port uuid="0db4838f-8419-4187-a457-94bb66310863">
Apr 12 09:47:28 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 12 09:47:28 user nova-compute[71482]:         </nova:port>
Apr 12 09:47:28 user nova-compute[71482]:       </nova:ports>
Apr 12 09:47:28 user nova-compute[71482]:     </nova:instance>
Apr 12 09:47:28 user nova-compute[71482]:   </metadata>
Apr 12 09:47:28 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:47:28 user nova-compute[71482]:     <system>
Apr 12 09:47:28 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:47:28 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:47:28 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:47:28 user nova-compute[71482]:       <entry name="serial">98f44ec7-7456-4cb7-9f46-bb19adeaa9b1</entry>
Apr 12 09:47:28 user nova-compute[71482]:       <entry name="uuid">98f44ec7-7456-4cb7-9f46-bb19adeaa9b1</entry>
Apr 12 09:47:28 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:47:28 user nova-compute[71482]:     </system>
Apr 12 09:47:28 user nova-compute[71482]:   </sysinfo>
Apr 12 09:47:28 user nova-compute[71482]:   <os>
Apr 12 09:47:28 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:47:28 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:47:28 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:47:28 user nova-compute[71482]:   </os>
Apr 12 09:47:28 user nova-compute[71482]:   <features>
Apr 12 09:47:28 user nova-compute[71482]:     <acpi/>
Apr 12 09:47:28 user nova-compute[71482]:     <apic/>
Apr 12 09:47:28 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:47:28 user nova-compute[71482]:   </features>
Apr 12 09:47:28 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:47:28 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:47:28 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:47:28 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:47:28 user nova-compute[71482]:   </clock>
Apr 12 09:47:28 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:47:28 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:47:28 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:47:28 user nova-compute[71482]:   </cpu>
Apr 12 09:47:28 user nova-compute[71482]:   <devices>
Apr 12 09:47:28 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:47:28 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:47:28 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk"/>
Apr 12 09:47:28 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:47:28 user nova-compute[71482]:     </disk>
Apr 12 09:47:28 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:47:28 user nova-compute[71482]:       <mac address="fa:16:3e:bd:ea:c1"/>
Apr 12 09:47:28 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:47:28 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:47:28 user nova-compute[71482]:       <target dev="tap0db4838f-84"/>
Apr 12 09:47:28 user nova-compute[71482]:     </interface>
Apr 12 09:47:28 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:47:28 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/console.log" append="off"/>
Apr 12 09:47:28 user nova-compute[71482]:     </serial>
Apr 12 09:47:28 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:47:28 user nova-compute[71482]:     <video>
Apr 12 09:47:28 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:47:28 user nova-compute[71482]:     </video>
Apr 12 09:47:28 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:47:28 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:47:28 user nova-compute[71482]:     </rng>
Apr 12 09:47:28 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:47:28 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:47:28 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:47:28 user nova-compute[71482]:     </memballoon>
Apr 12 09:47:28 user nova-compute[71482]:   </devices>
Apr 12 09:47:28 user nova-compute[71482]: </domain>
Apr 12 09:47:28 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-374987338',display_name='tempest-SnapshotDataIntegrityTests-server-374987338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-374987338',id=45,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjsDJkKscm/m1JO7QZ595+SiXDjpmpWhJ71MxZtaXRHacQPfxCqvNSfAjwlmPltSXx3TKyV4ATsW49g2lUlMNeiZh5xK2SmbT+BEk5RTvMv1raH8TwLLiSnYkURTu3Iaw==',key_name='tempest-SnapshotDataIntegrityTests-2042005072',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71345b53304d4b99b233f65d427343ba',ramdisk_id='',reservation_id='r-2009yyvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-977295797',owner_user_name='tempest-SnapshotDataIntegrityTests-977295797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:47:27Z,user_data=None,user_id='21416f43494540f2ad0c2e36edd3dc6f',uuid=98f44ec7-7456-4cb7-9f46-bb19adeaa9b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Converting VIF {"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ea:c1,bridge_name='br-int',has_traffic_filtering=True,id=0db4838f-8419-4187-a457-94bb66310863,network=Network(610b0245-1993-4002-acd5-0cd5ae10b1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db4838f-84') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG os_vif [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ea:c1,bridge_name='br-int',has_traffic_filtering=True,id=0db4838f-8419-4187-a457-94bb66310863,network=Network(610b0245-1993-4002-acd5-0cd5ae10b1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db4838f-84') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0db4838f-84, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0db4838f-84, col_values=(('external_ids', {'iface-id': '0db4838f-8419-4187-a457-94bb66310863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:ea:c1', 'vm-uuid': '98f44ec7-7456-4cb7-9f46-bb19adeaa9b1'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:28 user nova-compute[71482]: INFO os_vif [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:ea:c1,bridge_name='br-int',has_traffic_filtering=True,id=0db4838f-8419-4187-a457-94bb66310863,network=Network(610b0245-1993-4002-acd5-0cd5ae10b1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db4838f-84')
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No VIF found with MAC fa:16:3e:bd:ea:c1, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.network.neutron [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updated VIF entry in instance network info cache for port 0db4838f-8419-4187-a457-94bb66310863. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG nova.network.neutron [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating instance_info_cache with network_info: [{"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:47:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-21785de9-f364-4830-8aa7-0e036844e667 req-07773bb2-cb4a-48bb-a2cc-44f782e9977c service nova] Releasing lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:47:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received event network-vif-plugged-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:47:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:47:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:47:30 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:47:30 user nova-compute[71482]: DEBUG nova.compute.manager [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] No waiting events found dispatching network-vif-plugged-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:47:30 user nova-compute[71482]: WARNING nova.compute.manager [req-559cda7b-cfec-42d3-98a7-d15414e80757 req-b19e3161-585c-4675-908f-702a13f37d28 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received unexpected event network-vif-plugged-0db4838f-8419-4187-a457-94bb66310863 for instance with vm_state building and task_state spawning.
Apr 12 09:47:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:30 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:47:31 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292851.8396916, 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:47:32 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] VM Resumed (Lifecycle Event)
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:47:32 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Instance spawned successfully.
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:47:32 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:47:32 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8734MB free_disk=26.197174072265625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received event network-vif-plugged-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.manager [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] No waiting events found dispatching network-vif-plugged-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:47:32 user nova-compute[71482]: WARNING nova.compute.manager [req-94e31086-36fa-4b74-bbe7-f7f36ae06d62 req-6b6abf16-0dbc-4bae-8ed5-61169bf188fe service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received unexpected event network-vif-plugged-0db4838f-8419-4187-a457-94bb66310863 for instance with vm_state building and task_state spawning.
Apr 12 09:47:32 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681292851.8460104, 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:47:32 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] VM Started (Lifecycle Event)
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:47:32 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:47:32 user nova-compute[71482]: INFO nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Took 5.60 seconds to spawn the instance on the hypervisor.
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:47:32 user nova-compute[71482]: INFO nova.compute.manager [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Took 6.24 seconds to build instance.
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-41561c5c-5b87-46f1-8f80-d058522db6d9 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.360s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:47:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:47:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:47:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:48:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:48:12 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:48:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:48:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:48:14 user nova-compute[71482]: DEBUG nova.compute.manager [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing instance network info cache due to event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:48:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] Acquiring lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:48:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] Acquired lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:48:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:48:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updated VIF entry in instance network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:48:14 user nova-compute[71482]: DEBUG nova.network.neutron [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:48:14 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4de8b439-fd22-43fe-a6be-009acd1da225 req-9058a8d0-3ac3-4795-bd4b-e4d81dacfee5 service nova] Releasing lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing instance network info cache due to event network-changed-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] Acquiring lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] Acquired lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Refreshing network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:48:15 user nova-compute[71482]: INFO nova.compute.manager [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Detaching volume e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4
Apr 12 09:48:15 user nova-compute[71482]: INFO nova.virt.block_device [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Attempting to driver detach volume e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 from mountpoint /dev/vdb
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Attempting to detach device vdb from instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:48:15 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:48:15 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:48:15 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:48:15 user nova-compute[71482]:   <serial>e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4</serial>
Apr 12 09:48:15 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 09:48:15 user nova-compute[71482]: </disk>
Apr 12 09:48:15 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:48:15 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully detached device vdb from instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 from the persistent domain config.
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:48:15 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:48:15 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:48:15 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:48:15 user nova-compute[71482]:   <serial>e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4</serial>
Apr 12 09:48:15 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 12 09:48:15 user nova-compute[71482]: </disk>
Apr 12 09:48:15 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updated VIF entry in instance network info cache for port 62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.network.neutron [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [{"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-4dab33f7-5aa3-41e7-9c87-4cc9572923ff req-b437ecd6-f19f-4fbc-9751-5b05302ea9a2 service nova] Releasing lock "refresh_cache-b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681292895.9032648, b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:48:15 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully detached device vdb from instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 from the live domain config.
Apr 12 09:48:15 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jYkrCwDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:48:15 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb9dd1a-0e5b-4777-ae14-49054724f3b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:48:15 user nova-compute[71482]: No targets found.
Apr 12 09:48:15 user nova-compute[71482]: iSNS:
Apr 12 09:48:15 user nova-compute[71482]: No targets found.
Apr 12 09:48:15 user nova-compute[71482]: STATIC:
Apr 12 09:48:15 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4
Apr 12 09:48:15 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:48:15 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:48:15 user nova-compute[71482]: FIRMWARE:
Apr 12 09:48:15 user nova-compute[71482]: No targets found.
Apr 12 09:48:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:48:15 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:48:15 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb44e40-68b6-4dd3-ae17-d9af0b303e6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99a3774-e9f2-42d7-83f4-332436762fb5]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)
Apr 12 09:48:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 (non-flash)
Apr 12 09:48:15 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c202050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:48:15 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[499d8d5c-42b4-45f1-b8ea-ab98fbcd020d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[813575aa-2217-416c-9b35-378b6cba04c7]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ec4470-4c2a-43b0-b1eb-773decc34506]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7da610-3aa7-434a-9b89-3d11c686e536]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfff89b-bed8-4672-9f85-5418bf1d39b6]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14d9d2a-b11c-443e-86dc-8a600662a5a5]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260]
Apr 12 09:48:16 user nova-compute[71482]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4, portal: 172.16.0.220,3260] successful.
Apr 12 09:48:16 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5c37c0b-de3f-4e40-9ebe-3f67a5b1fbd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b4bf59-a820-487a-8535-c3c15fdac887]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] <== disconnect_volume: return (289ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:48:16 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:48:17 user nova-compute[71482]: DEBUG nova.objects.instance [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'flavor' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:48:17 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:48:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-25adcea9-5068-4642-9f5e-96e0170166e3 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:48:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:48:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:48:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:48:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:48:22 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:48:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:48:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:48:33 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:48:33 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:48:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=26.176448822021484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:48:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:48:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:48:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:48:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:48:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:48:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:48:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:48:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:48:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:48:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:48:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:49:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:49:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:07 user nova-compute[71482]: INFO nova.compute.manager [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Terminating instance
Apr 12 09:49:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-unplugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] No waiting events found dispatching network-vif-unplugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-452af1eb-333c-43dc-82f7-786ddbacf8b2 req-8c6bae1f-09e2-4c41-86e8-7989cf62cdda service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-unplugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:08 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Instance destroyed successfully.
Apr 12 09:49:08 user nova-compute[71482]: DEBUG nova.objects.instance [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'resources' on Instance uuid b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1404599988',display_name='tempest-TestMinimumBasicScenario-server-1404599988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1404599988',id=44,image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFOqIN1Pf1NB/QjxUMaNgH6RoPt5npz9d2f3DihQHSx4VSWqvA79iJxXvGaIRpuSkyfaxajHPH7p7S1YgzHrmkTia3ryFD9Hgdem+xd8sFXeghoii97Du2AgQJb6GqD2w==',key_name='tempest-TestMinimumBasicScenario-677654037',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:44:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='044d0193867a407ba80522df35f5d667',ramdisk_id='',reservation_id='r-lf4zsa2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bf78848c-38c3-43e7-b908-42b091dbbdbd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-935210424',owner_user_name='tempest-TestMinimumBasicScenario-935210424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:46:31Z,user_data=None,user_id='345fff9dd4ce4b74bc87ff29db51e162',uuid=b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converting VIF {"id": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "address": "fa:16:3e:f0:e0:ec", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62eb8dd5-7e", "ovs_interfaceid": "62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG os_vif [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62eb8dd5-7e, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:49:08 user nova-compute[71482]: INFO os_vif [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:e0:ec,bridge_name='br-int',has_traffic_filtering=True,id=62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62eb8dd5-7e')
Apr 12 09:49:08 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Deleting instance files /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67_del
Apr 12 09:49:08 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Deletion of /opt/stack/data/nova/instances/b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67_del complete
Apr 12 09:49:08 user nova-compute[71482]: INFO nova.compute.manager [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 12 09:49:08 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:49:08 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:49:09 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:49:09 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Took 0.46 seconds to deallocate network for instance.
Apr 12 09:49:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-4bc66a06-c71c-4fe2-a0dc-b3e70474d7c2 req-07e2da43-d2fc-4d00-a975-c6305c2ddbb1 service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-deleted-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:49:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:09 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:49:09 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:49:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:09 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Deleted allocations for instance b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67
Apr 12 09:49:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26207b62-44e5-430d-b156-fdc1e3b8fecd tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.689s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] Acquiring lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] Lock "b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG nova.compute.manager [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] No waiting events found dispatching network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:49:10 user nova-compute[71482]: WARNING nova.compute.manager [req-e056f8f0-80f3-41fc-8f23-4c8d86a259f4 req-7b8adddf-2a8c-453f-9cf5-0fea449791fa service nova] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Received unexpected event network-vif-plugged-62eb8dd5-7ea7-4c6e-8722-9dfbda06bb5d for instance with vm_state deleted and task_state None.
Apr 12 09:49:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating instance_info_cache with network_info: [{"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:49:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:49:12 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:49:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:49:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:49:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:49:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG nova.compute.manager [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received event network-changed-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG nova.compute.manager [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Refreshing instance network info cache due to event network-changed-0db4838f-8419-4187-a457-94bb66310863. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] Acquiring lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] Acquired lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Refreshing network info cache for port 0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:19 user nova-compute[71482]: INFO nova.compute.manager [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attaching volume 7576e648-fab5-40a5-9a36-8951a764f77c to /dev/vdb
Apr 12 09:49:19 user nova-compute[71482]: DEBUG os_brick.utils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[80384f77-28a5-4e53-907c-528a2d62290b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc034a6-1ef7-487d-bd1f-1e4085403d9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updated VIF entry in instance network info cache for port 0db4838f-8419-4187-a457-94bb66310863. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG nova.network.neutron [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating instance_info_cache with network_info: [{"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b05e6a-94df-4374-8e54-ee01e8e39e5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39e9e9e-e9b9-40b9-99d1-e5be04b69c62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-93369bb4-754f-4857-88e5-f9aaba12d3be req-1de7cd90-b9db-4abe-ac72-adc0153411c3 service nova] Releasing lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:49:19 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:49:19 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5772ba7f-e2e7-4c4f-94ba-0de1bcc40ba6]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG os_brick.utils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:49:19 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating existing volume attachment record: 80b556ca-eb78-42e9-849f-c563646d1fcc {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:49:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681292948.7548378, b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:49:23 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] VM Stopped (Lifecycle Event)
Apr 12 09:49:23 user nova-compute[71482]: DEBUG nova.compute.manager [None req-157beebb-bba9-4cd7-87b4-8a884956758b None None] [instance: b5cb0988-c2c5-4788-8c8c-5eb1c23a1f67] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guAyvoxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:49:23 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:49:23 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:49:23 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abdfc66-865a-4e4a-80af-ed21c273b00c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:49:23 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5572687-8eb2-496f-89ac-308d611224bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c] added
Apr 12 09:49:23 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[54465142-528f-4a57-a79d-02f8f25ed359]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab3d8c3-53f3-4d2c-b11e-2022d71e87b7]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v guAyvoxQ {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v guAyvoxQ" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45984f81-a709-482a-8329-edfed22dc675]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'guAyvoxQ'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[06445a39-ffc6-4a29-91fe-e8e73ba65b67]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:23 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[71af2378-d7ea-465c-b790-f283aa43e5a0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:49:24 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:49:24 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:49:24 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:49:24 user nova-compute[71482]: 
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca2f706-5a6d-4832-a8e2-4dccfb3a7404]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c, portal: 172.16.0.220,3260]
Apr 12 09:49:24 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c, portal: 172.16.0.220,3260] successful.
Apr 12 09:49:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d54cb-9b51-43a4-80a8-224dbc78faa5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac1869a-b052-48a2-b2c4-4e24765011b2]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c (non-flash)
Apr 12 09:49:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c (non-flash)
Apr 12 09:49:24 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08139aa-bfc8-4e78-9245-20eda94dbcd0]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:24 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guAyvoxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26361396137646333', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361396137646333', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG nova.objects.instance [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:49:25 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:49:25 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:49:25 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:49:25 user nova-compute[71482]:   <serial>7576e648-fab5-40a5-9a36-8951a764f77c</serial>
Apr 12 09:49:25 user nova-compute[71482]: </disk>
Apr 12 09:49:25 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No VIF found with MAC fa:16:3e:bd:ea:c1, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:49:25 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-8d4df2e6-006e-402e-ad79-6bb3cb195dba tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.335s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:33 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:49:33 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:49:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=26.195053100585938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:49:33 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:49:34 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:49:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:49:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:49:34 user nova-compute[71482]: INFO nova.compute.manager [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Detaching volume 7576e648-fab5-40a5-9a36-8951a764f77c
Apr 12 09:49:34 user nova-compute[71482]: INFO nova.virt.block_device [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attempting to driver detach volume 7576e648-fab5-40a5-9a36-8951a764f77c from mountpoint /dev/vdb
Apr 12 09:49:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Attempting to detach device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:49:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:49:34 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:49:34 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:49:34 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:49:34 user nova-compute[71482]:   <serial>7576e648-fab5-40a5-9a36-8951a764f77c</serial>
Apr 12 09:49:34 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:49:34 user nova-compute[71482]: </disk>
Apr 12 09:49:34 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:49:34 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully detached device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the persistent domain config.
Apr 12 09:49:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:49:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:49:34 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:49:34 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:49:34 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:49:34 user nova-compute[71482]:   <serial>7576e648-fab5-40a5-9a36-8951a764f77c</serial>
Apr 12 09:49:34 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:49:34 user nova-compute[71482]: </disk>
Apr 12 09:49:34 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681292975.2155375, 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:49:35 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully detached device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the live domain config.
Apr 12 09:49:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'guAyvoxQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:49:35 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1725e5c8-54a1-444f-bd93-8c3f99a89512]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:49:35 user nova-compute[71482]: No targets found.
Apr 12 09:49:35 user nova-compute[71482]: iSNS:
Apr 12 09:49:35 user nova-compute[71482]: No targets found.
Apr 12 09:49:35 user nova-compute[71482]: STATIC:
Apr 12 09:49:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c
Apr 12 09:49:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:49:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:49:35 user nova-compute[71482]: FIRMWARE:
Apr 12 09:49:35 user nova-compute[71482]: No targets found.
Apr 12 09:49:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:49:35 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:49:35 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[476b4705-08fe-4efb-98e0-32189f0d7fb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe60579c-039f-42ff-a901-8195693e6746]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c (non-flash)
Apr 12 09:49:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c (non-flash)
Apr 12 09:49:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9349b800d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b124ed0-6297-4de2-9c56-5b106b566c06]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f5d808-6ea1-4959-8e76-f030c9c875e7]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[014d245f-3905-4493-99fd-1f5a4436b051]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[673012c9-02a7-4337-bc46-512f9ca4ec10]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7145b33-09f1-4ce2-9ca4-7080b8181a67]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[db605b54-08ce-4129-b719-9d241c62f6d9]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c, portal: 172.16.0.220,3260]
Apr 12 09:49:35 user nova-compute[71482]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c, portal: 172.16.0.220,3260] successful.
Apr 12 09:49:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7576e648-fab5-40a5-9a36-8951a764f77c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[754fcde5-8e10-4be6-9dd6-272afbfa809e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== disconnect_volume: return (285ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:49:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:49:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:49:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-36ebe44b-4261-4625-b048-ff1c268eabde tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:49:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:49:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:49:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:50:02 user nova-compute[71482]: INFO nova.compute.claims [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Claim successful on node user
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.224s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.network.neutron [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:50:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.policy [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '345fff9dd4ce4b74bc87ff29db51e162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044d0193867a407ba80522df35f5d667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:50:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Creating image(s)
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "/opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "/opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "/opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "a0f3b1c58847ea945820a4a7962f6f078dc3fad0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "a0f3b1c58847ea945820a4a7962f6f078dc3fad0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0.part --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0.part --force-share --output=json" returned: 0 in 0.159s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG nova.virt.images [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 98a59b0c-b130-489f-b5f6-1f8372109214 was qcow2, converting to raw {{(pid=71482) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG nova.privsep.utils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71482) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0.part /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0.converted {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG nova.network.neutron [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Successfully created port: ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0.part /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0.converted" returned: 0 in 0.240s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0.converted --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0.converted --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "a0f3b1c58847ea945820a4a7962f6f078dc3fad0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.871s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0 --force-share --output=json" returned: 0 in 0.146s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "a0f3b1c58847ea945820a4a7962f6f078dc3fad0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "a0f3b1c58847ea945820a4a7962f6f078dc3fad0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0 --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0,backing_fmt=raw /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk 1073741824 {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0,backing_fmt=raw /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk 1073741824" returned: 0 in 0.053s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "a0f3b1c58847ea945820a4a7962f6f078dc3fad0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:03 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0 --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Successfully updated port: ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.compute.manager [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing instance network info cache due to event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a0f3b1c58847ea945820a4a7962f6f078dc3fad0 --force-share --output=json" returned: 0 in 0.140s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk. size=1073741824 {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.disk.api [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Cannot resize image /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk to a smaller size. {{(pid=71482) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.objects.instance [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'migration_context' on Instance uuid 038696c5-53db-4679-b396-2328710f8cdd {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Created local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Ensure instance console log exists: /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.neutron [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Instance network_info: |[{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.neutron [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Start _get_guest_xml network_info=[{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:49:59Z,direct_url=<?>,disk_format='qcow2',id=98a59b0c-b130-489f-b5f6-1f8372109214,min_disk=0,min_ram=0,name='tempest-scenario-img--494119589',owner='044d0193867a407ba80522df35f5d667',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:50:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'device_name': '/dev/vda', 'encryption_format': None, 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '98a59b0c-b130-489f-b5f6-1f8372109214'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:50:04 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:50:04 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-12T09:49:59Z,direct_url=<?>,disk_format='qcow2',id=98a59b0c-b130-489f-b5f6-1f8372109214,min_disk=0,min_ram=0,name='tempest-scenario-img--494119589',owner='044d0193867a407ba80522df35f5d667',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-12T09:50:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:50:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1994871489',display_name='tempest-TestMinimumBasicScenario-server-1994871489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1994871489',id=46,image_ref='98a59b0c-b130-489f-b5f6-1f8372109214',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnFaeD5GW9hY7Blf+Pjo28Vs1JAT8Z90GiQtJ9zEC7ZRQvTPKDHKGOj7tm4xggd2XKmjB24E2nvfrSxbRu5ogbU+9Fl/0PqUIw50qaxHirma1o6zI0F2bDm2CZnSNpICg==',key_name='tempest-TestMinimumBasicScenario-1594156326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='044d0193867a407ba80522df35f5d667',ramdisk_id='',reservation_id='r-6vu00wm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='98a59b0c-b130-489f-b5f6-1f8372109214',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-935210424',owner_user_name='tempest-TestMinimumBasicScenario-935210424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:50:03Z,user_data=None,user_id='345fff9dd4ce4b74bc87ff29db51e162',uuid=038696c5-53db-4679-b396-2328710f8cdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converting VIF {"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:1e:1a,bridge_name='br-int',has_traffic_filtering=True,id=ace77f6f-c8a8-4565-b457-95d085efb6f6,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace77f6f-c8') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.objects.instance [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'pci_devices' on Instance uuid 038696c5-53db-4679-b396-2328710f8cdd {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:50:04 user nova-compute[71482]:   <uuid>038696c5-53db-4679-b396-2328710f8cdd</uuid>
Apr 12 09:50:04 user nova-compute[71482]:   <name>instance-0000002e</name>
Apr 12 09:50:04 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:50:04 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:50:04 user nova-compute[71482]:   <metadata>
Apr 12 09:50:04 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:50:04 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:50:04 user nova-compute[71482]:       <nova:name>tempest-TestMinimumBasicScenario-server-1994871489</nova:name>
Apr 12 09:50:04 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:50:04</nova:creationTime>
Apr 12 09:50:04 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:50:04 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:50:04 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:50:04 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:50:04 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:50:04 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:50:04 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:50:04 user nova-compute[71482]:       <nova:owner>
Apr 12 09:50:04 user nova-compute[71482]:         <nova:user uuid="345fff9dd4ce4b74bc87ff29db51e162">tempest-TestMinimumBasicScenario-935210424-project-member</nova:user>
Apr 12 09:50:04 user nova-compute[71482]:         <nova:project uuid="044d0193867a407ba80522df35f5d667">tempest-TestMinimumBasicScenario-935210424</nova:project>
Apr 12 09:50:04 user nova-compute[71482]:       </nova:owner>
Apr 12 09:50:04 user nova-compute[71482]:       <nova:root type="image" uuid="98a59b0c-b130-489f-b5f6-1f8372109214"/>
Apr 12 09:50:04 user nova-compute[71482]:       <nova:ports>
Apr 12 09:50:04 user nova-compute[71482]:         <nova:port uuid="ace77f6f-c8a8-4565-b457-95d085efb6f6">
Apr 12 09:50:04 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 12 09:50:04 user nova-compute[71482]:         </nova:port>
Apr 12 09:50:04 user nova-compute[71482]:       </nova:ports>
Apr 12 09:50:04 user nova-compute[71482]:     </nova:instance>
Apr 12 09:50:04 user nova-compute[71482]:   </metadata>
Apr 12 09:50:04 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:50:04 user nova-compute[71482]:     <system>
Apr 12 09:50:04 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:50:04 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:50:04 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:50:04 user nova-compute[71482]:       <entry name="serial">038696c5-53db-4679-b396-2328710f8cdd</entry>
Apr 12 09:50:04 user nova-compute[71482]:       <entry name="uuid">038696c5-53db-4679-b396-2328710f8cdd</entry>
Apr 12 09:50:04 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:50:04 user nova-compute[71482]:     </system>
Apr 12 09:50:04 user nova-compute[71482]:   </sysinfo>
Apr 12 09:50:04 user nova-compute[71482]:   <os>
Apr 12 09:50:04 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:50:04 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:50:04 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:50:04 user nova-compute[71482]:   </os>
Apr 12 09:50:04 user nova-compute[71482]:   <features>
Apr 12 09:50:04 user nova-compute[71482]:     <acpi/>
Apr 12 09:50:04 user nova-compute[71482]:     <apic/>
Apr 12 09:50:04 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:50:04 user nova-compute[71482]:   </features>
Apr 12 09:50:04 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:50:04 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:50:04 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:50:04 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:50:04 user nova-compute[71482]:   </clock>
Apr 12 09:50:04 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:50:04 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:50:04 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:50:04 user nova-compute[71482]:   </cpu>
Apr 12 09:50:04 user nova-compute[71482]:   <devices>
Apr 12 09:50:04 user nova-compute[71482]:     <disk type="file" device="disk">
Apr 12 09:50:04 user nova-compute[71482]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 12 09:50:04 user nova-compute[71482]:       <source file="/opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk"/>
Apr 12 09:50:04 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:50:04 user nova-compute[71482]:     </disk>
Apr 12 09:50:04 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:50:04 user nova-compute[71482]:       <mac address="fa:16:3e:ef:1e:1a"/>
Apr 12 09:50:04 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:50:04 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:50:04 user nova-compute[71482]:       <target dev="tapace77f6f-c8"/>
Apr 12 09:50:04 user nova-compute[71482]:     </interface>
Apr 12 09:50:04 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:50:04 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/console.log" append="off"/>
Apr 12 09:50:04 user nova-compute[71482]:     </serial>
Apr 12 09:50:04 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:50:04 user nova-compute[71482]:     <video>
Apr 12 09:50:04 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:50:04 user nova-compute[71482]:     </video>
Apr 12 09:50:04 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:50:04 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:50:04 user nova-compute[71482]:     </rng>
Apr 12 09:50:04 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:50:04 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:50:04 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:50:04 user nova-compute[71482]:     </memballoon>
Apr 12 09:50:04 user nova-compute[71482]:   </devices>
Apr 12 09:50:04 user nova-compute[71482]: </domain>
Apr 12 09:50:04 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:50:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1994871489',display_name='tempest-TestMinimumBasicScenario-server-1994871489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1994871489',id=46,image_ref='98a59b0c-b130-489f-b5f6-1f8372109214',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnFaeD5GW9hY7Blf+Pjo28Vs1JAT8Z90GiQtJ9zEC7ZRQvTPKDHKGOj7tm4xggd2XKmjB24E2nvfrSxbRu5ogbU+9Fl/0PqUIw50qaxHirma1o6zI0F2bDm2CZnSNpICg==',key_name='tempest-TestMinimumBasicScenario-1594156326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='044d0193867a407ba80522df35f5d667',ramdisk_id='',reservation_id='r-6vu00wm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='98a59b0c-b130-489f-b5f6-1f8372109214',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-935210424',owner_user_name='tempest-TestMinimumBasicScenario-935210424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:50:03Z,user_data=None,user_id='345fff9dd4ce4b74bc87ff29db51e162',uuid=038696c5-53db-4679-b396-2328710f8cdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converting VIF {"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:1e:1a,bridge_name='br-int',has_traffic_filtering=True,id=ace77f6f-c8a8-4565-b457-95d085efb6f6,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace77f6f-c8') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG os_vif [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:1e:1a,bridge_name='br-int',has_traffic_filtering=True,id=ace77f6f-c8a8-4565-b457-95d085efb6f6,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace77f6f-c8') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapace77f6f-c8, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapace77f6f-c8, col_values=(('external_ids', {'iface-id': 'ace77f6f-c8a8-4565-b457-95d085efb6f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:1e:1a', 'vm-uuid': '038696c5-53db-4679-b396-2328710f8cdd'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:04 user nova-compute[71482]: INFO os_vif [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:1e:1a,bridge_name='br-int',has_traffic_filtering=True,id=ace77f6f-c8a8-4565-b457-95d085efb6f6,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace77f6f-c8')
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No VIF found with MAC fa:16:3e:ef:1e:1a, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.neutron [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updated VIF entry in instance network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG nova.network.neutron [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:50:04 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-75a7e645-4f86-429d-8965-70a820c3e073 req-c13121af-f217-42f1-87e9-a57b7dd81744 service nova] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:50:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:05 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:50:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:06 user nova-compute[71482]: DEBUG nova.compute.manager [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:50:06 user nova-compute[71482]: WARNING nova.compute.manager [req-f90b01a6-c1a4-4896-b15e-66567705eb39 req-2d745938-ef32-44ce-a95f-7c54a395871a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state building and task_state spawning.
Apr 12 09:50:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:07 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681293007.96452, 038696c5-53db-4679-b396-2328710f8cdd => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:50:07 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] VM Resumed (Lifecycle Event)
Apr 12 09:50:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:50:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:50:07 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Instance spawned successfully.
Apr 12 09:50:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:50:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:50:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:50:07 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:50:08 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681293007.9688694, 038696c5-53db-4679-b396-2328710f8cdd => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:50:08 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] VM Started (Lifecycle Event)
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:50:08 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:50:08 user nova-compute[71482]: INFO nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Took 5.40 seconds to spawn the instance on the hypervisor.
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:08 user nova-compute[71482]: DEBUG nova.compute.manager [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:50:08 user nova-compute[71482]: WARNING nova.compute.manager [req-1e842a4a-0e30-4837-ac08-71012143fa25 req-0acc0631-b416-4582-a5c1-e9196f43b8a0 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state building and task_state spawning.
Apr 12 09:50:08 user nova-compute[71482]: INFO nova.compute.manager [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Took 5.98 seconds to build instance.
Apr 12 09:50:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-94b123f6-be5b-4c08-bc84-853df0e03951 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.076s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating instance_info_cache with network_info: [{"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:50:10 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:50:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:17 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:50:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:50:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:50:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:50:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:27 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:50:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:27 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:27 user nova-compute[71482]: INFO nova.compute.manager [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attaching volume f7d16719-f633-43f0-ac1d-a4624f32a587 to /dev/vdb
Apr 12 09:50:28 user nova-compute[71482]: DEBUG os_brick.utils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba5d947-a75a-4e97-bf4a-b467ea55cc45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[125d6069-a99e-4de9-a7fc-1645fb0ac757]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7dee46-ef5f-4042-b186-0f0e2ec982c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f38379-aaea-46e0-a709-ae930f4a9dd8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:50:28 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:50:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bd0f35-6205-4e98-9dca-ab6cc8352b91]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG os_brick.utils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:50:28 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating existing volume attachment record: 6d60b1db-5ebe-400b-99d8-435f3ebe1b1b {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:50:29 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rcIePHfd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:50:32 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:50:32 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:50:32 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96227cbc-7ea4-4c2f-9894-eae32f712b5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:50:32 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[918ca68a-e38a-4ae0-a21a-2547328907bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587] added
Apr 12 09:50:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[981aadd5-c3a6-4b23-ab6c-4e727961d602]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2f3b21-f1e0-4154-959c-845f0a6e33c2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rcIePHfd {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rcIePHfd" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c9f689-1734-44be-a63d-0a7cc71ba1b7]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rcIePHfd'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82c26c6-8f20-4b7e-bac2-e4a18c66b131]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b04343-30da-438a-8b78-de6b3994e9fb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:50:32 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:50:32 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:50:32 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:50:32 user nova-compute[71482]: 
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e678b79b-13c2-4072-9b60-b282e7f37e5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587, portal: 172.16.0.220,3260]
Apr 12 09:50:32 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587, portal: 172.16.0.220,3260] successful.
Apr 12 09:50:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa5ace0-e365-445e-b260-19e5fe2082d5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e484c19-a4f7-40ca-af34-fc5cb08a413c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 (non-flash)
Apr 12 09:50:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 (non-flash)
Apr 12 09:50:32 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[96352976-367b-4b94-8a04-edcefad870a7]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:50:32 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rcIePHfd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:50:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:50:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23738656631356361', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:50:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738656631356361', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:50:33 user nova-compute[71482]: DEBUG nova.objects.instance [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:50:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:50:33 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:50:33 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:50:33 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:50:33 user nova-compute[71482]:   <serial>f7d16719-f633-43f0-ac1d-a4624f32a587</serial>
Apr 12 09:50:33 user nova-compute[71482]: </disk>
Apr 12 09:50:33 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No VIF found with MAC fa:16:3e:bd:ea:c1, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-e9146a13-f95f-47b0-896a-1178d0ca97b8 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.202s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:50:35 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8652MB free_disk=26.157230377197266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:50:35 user nova-compute[71482]: INFO nova.compute.manager [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Detaching volume f7d16719-f633-43f0-ac1d-a4624f32a587
Apr 12 09:50:35 user nova-compute[71482]: INFO nova.virt.block_device [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attempting to driver detach volume f7d16719-f633-43f0-ac1d-a4624f32a587 from mountpoint /dev/vdb
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Attempting to detach device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:50:35 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:50:35 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:50:35 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:50:35 user nova-compute[71482]:   <serial>f7d16719-f633-43f0-ac1d-a4624f32a587</serial>
Apr 12 09:50:35 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:50:35 user nova-compute[71482]: </disk>
Apr 12 09:50:35 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:50:35 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully detached device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the persistent domain config.
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:50:35 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:50:35 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:50:35 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:50:35 user nova-compute[71482]:   <serial>f7d16719-f633-43f0-ac1d-a4624f32a587</serial>
Apr 12 09:50:35 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:50:35 user nova-compute[71482]: </disk>
Apr 12 09:50:35 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 038696c5-53db-4679-b396-2328710f8cdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681293035.6401892, 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:50:35 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully detached device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the live domain config.
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rcIePHfd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:50:35 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[935083bc-8440-4cfa-9517-d18d885e6e9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:50:35 user nova-compute[71482]: No targets found.
Apr 12 09:50:35 user nova-compute[71482]: iSNS:
Apr 12 09:50:35 user nova-compute[71482]: No targets found.
Apr 12 09:50:35 user nova-compute[71482]: STATIC:
Apr 12 09:50:35 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587
Apr 12 09:50:35 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:50:35 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:50:35 user nova-compute[71482]: FIRMWARE:
Apr 12 09:50:35 user nova-compute[71482]: No targets found.
Apr 12 09:50:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:50:35 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:50:35 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e07b9-3455-4cfa-86b3-a326385137f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[802ad373-3b00-499e-b7b0-a2ece70a6fe6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 (non-flash)
Apr 12 09:50:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 (non-flash)
Apr 12 09:50:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9349cd6170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb00c16-76dc-425d-bc98-94180bb41fa7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc545ba6-4720-49a9-9937-35c04f85495d]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be4cf94-ef20-42a4-b5b1-f682e12debde]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9f8aa2-90bd-40e9-a239-eb03bbc0895d]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[850979fe-689e-4322-b638-67491598f39f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9295df32-ae71-49be-9246-36ff73b63a58]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587, portal: 172.16.0.220,3260]
Apr 12 09:50:35 user nova-compute[71482]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587, portal: 172.16.0.220,3260] successful.
Apr 12 09:50:35 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7d16719-f633-43f0-ac1d-a4624f32a587 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d2c1f-57f5-4364-8b6a-1162b7c6e107]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== disconnect_volume: return (276ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:50:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:50:36 user nova-compute[71482]: DEBUG nova.objects.instance [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:50:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-3416d8bf-6fa9-439d-986a-3dc642f66754 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.574s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:50:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:50:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:50:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:50:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:50:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:50:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:50:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:51:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:51:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:51:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:51:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:51:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:51:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:51:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:51:12 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:51:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:51:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:51:14 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:51:17 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:51:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:51:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:25 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:26 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG nova.objects.instance [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:51:28 user nova-compute[71482]: INFO nova.compute.manager [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attaching volume 236d7a57-e5bf-4a4d-b5e7-178c2682e457 to /dev/vdb
Apr 12 09:51:28 user nova-compute[71482]: DEBUG os_brick.utils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1646077-0914-428e-9646-64928308d803]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a31f0-d8c1-4282-977d-27919ef1160b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6cd0a4-60fc-4d17-a8aa-2b020ba97f04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9675d8e6-4469-4697-8d4d-91fde40749b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:51:28 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:51:28 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f95009-cb12-441f-9197-2ed44d0fffb8]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG os_brick.utils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:51:28 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating existing volume attachment record: a8a892ee-d6ed-418b-8a7f-f06bfad9e815 {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:51:29 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzeFMHGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:51:33 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:51:33 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:51:33 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3da8ac-529e-4b4c-bee8-9719f0be1ab0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:51:33 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b68d9d-fcb3-4dd0-b872-9c28f6182fe2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457] added
Apr 12 09:51:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f974e24-ab0c-449e-8f8d-1cea8b9ac8e5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0232f072-98be-4d1e-9bd4-504ead00ef32]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzeFMHGg {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uzeFMHGg" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a1b159-5770-4c94-a1d1-6f2eea12f12a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uzeFMHGg'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[89333fc8-75ac-4f83-994a-cddec38f6ab8]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdebb73d-651a-4fe6-bd89-8124881a5ff3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:51:33 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:51:33 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:51:33 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:51:33 user nova-compute[71482]: 
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a905e6-d145-4b65-9c32-39c965d08f4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457, portal: 172.16.0.220,3260]
Apr 12 09:51:33 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457, portal: 172.16.0.220,3260] successful.
Apr 12 09:51:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4a1721-a8e7-43f2-9910-f6f27254fe44]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1058b93-c959-4d4f-bfda-de757ef6f19a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 (non-flash)
Apr 12 09:51:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 (non-flash)
Apr 12 09:51:33 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a0fd2a-39f6-4d42-a962-1a107d6a6145]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:51:33 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzeFMHGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23430326263376266', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430326263376266', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG nova.objects.instance [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:51:34 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:51:34 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:51:34 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:51:34 user nova-compute[71482]:   <serial>236d7a57-e5bf-4a4d-b5e7-178c2682e457</serial>
Apr 12 09:51:34 user nova-compute[71482]: </disk>
Apr 12 09:51:34 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No VIF found with MAC fa:16:3e:bd:ea:c1, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:51:34 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-616c8512-17f1-4446-8f23-f77ea0e7dc09 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.505s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:35 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:36 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:51:36 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=26.15603256225586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 038696c5-53db-4679-b396-2328710f8cdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:51:36 user nova-compute[71482]: INFO nova.compute.manager [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Detaching volume 236d7a57-e5bf-4a4d-b5e7-178c2682e457
Apr 12 09:51:36 user nova-compute[71482]: INFO nova.virt.block_device [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attempting to driver detach volume 236d7a57-e5bf-4a4d-b5e7-178c2682e457 from mountpoint /dev/vdb
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Attempting to detach device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:51:36 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:51:36 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:51:36 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:51:36 user nova-compute[71482]:   <serial>236d7a57-e5bf-4a4d-b5e7-178c2682e457</serial>
Apr 12 09:51:36 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:51:36 user nova-compute[71482]: </disk>
Apr 12 09:51:36 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:51:36 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully detached device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the persistent domain config.
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:51:36 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:51:36 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:51:36 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:51:36 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:51:36 user nova-compute[71482]:   <serial>236d7a57-e5bf-4a4d-b5e7-178c2682e457</serial>
Apr 12 09:51:36 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:51:36 user nova-compute[71482]: </disk>
Apr 12 09:51:36 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681293097.1011887, 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:51:37 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully detached device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the live domain config.
Apr 12 09:51:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uzeFMHGg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:51:37 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e6ce0f-dbae-4321-8024-2e01ed1394c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:51:37 user nova-compute[71482]: No targets found.
Apr 12 09:51:37 user nova-compute[71482]: iSNS:
Apr 12 09:51:37 user nova-compute[71482]: No targets found.
Apr 12 09:51:37 user nova-compute[71482]: STATIC:
Apr 12 09:51:37 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457
Apr 12 09:51:37 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:51:37 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:51:37 user nova-compute[71482]: FIRMWARE:
Apr 12 09:51:37 user nova-compute[71482]: No targets found.
Apr 12 09:51:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:51:37 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:51:37 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8449626b-84ef-4355-afe0-d51bc0d232ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[be948b5f-2a27-4d13-80fe-a5dbd466de70]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 (non-flash)
Apr 12 09:51:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 (non-flash)
Apr 12 09:51:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f93443508b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a7b96f-7dc1-4532-bfc1-fe7ceae819a4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[705fdcdf-202e-4598-8ea2-af43fb8c9d50]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1d531a-f77d-4ebf-83e4-fb2eb447cf2e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5f7722-ded4-4879-b93e-d68f08058f72]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d4e55-e874-4218-8666-412b8e993a45]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e64dd8-9cf4-47ce-8059-70047edcd93d]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457, portal: 172.16.0.220,3260]
Apr 12 09:51:37 user nova-compute[71482]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457, portal: 172.16.0.220,3260] successful.
Apr 12 09:51:37 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:236d7a57-e5bf-4a4d-b5e7-178c2682e457 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d686f49-79e8-4bf5-aeb7-494e8342af22]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== disconnect_volume: return (291ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:51:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:51:38 user nova-compute[71482]: DEBUG nova.objects.instance [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:51:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-61377474-a005-4267-987a-e56ed1826cc2 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.714s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:51:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:51:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG nova.objects.instance [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'flavor' on Instance uuid 038696c5-53db-4679-b396-2328710f8cdd {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:51:54 user nova-compute[71482]: INFO nova.compute.manager [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Attaching volume 9b294eb4-8109-4d1d-b1a9-da4ff04df141 to /dev/vdb
Apr 12 09:51:54 user nova-compute[71482]: DEBUG os_brick.utils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc13d04-842a-4bb5-a9b3-9c793fd8a42c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a94dea-0f89-4930-bbf5-c7f7cacdb7d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0893dece-5559-4ce9-a126-578ae6f5a820]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c1dad3-401f-4370-87f5-bd97970da48c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:51:54 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:51:54 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3dabba-dc64-4975-81d4-64c136431b83]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG os_brick.utils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:51:54 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating existing volume attachment record: c0646ca3-b10d-4843-9368-d46a1afe44ed {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSWPGBQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:51:58 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:51:58 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:51:58 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d19d529-9339-4aa6-9261-71508e9567d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:51:58 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c232d50-a030-41f1-9b16-d47a8f2d30c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141] added
Apr 12 09:51:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8b5756-338b-45a4-8037-bcc8ab310ac2]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dbe6d9-6569-4d29-bc28-08d0314383f1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSWPGBQE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSWPGBQE" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa272d6-6ba5-4438-8c31-36f272cde083]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iSWPGBQE'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7960c7e-40a8-4f9e-93a3-7f8e38553d6d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9061b457-c3f2-4337-930e-6dc6de440dc0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:51:58 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:51:58 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:51:58 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:51:58 user nova-compute[71482]: 
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[379132e1-780f-455f-8f9e-2a1688640801]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141, portal: 172.16.0.220,3260]
Apr 12 09:51:58 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141, portal: 172.16.0.220,3260] successful.
Apr 12 09:51:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7526d66-21ae-4088-9530-8e28b585eead]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:51:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45884350-d5ed-448e-a6cc-d8c131eb294e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:51:59 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:51:59 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddbc0e0-96c5-4898-bba3-791b87ae46c6]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSWPGBQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:51:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:52:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:52:00 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23139366162653862', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:52:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139366162653862', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:52:00 user nova-compute[71482]: DEBUG nova.objects.instance [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'flavor' on Instance uuid 038696c5-53db-4679-b396-2328710f8cdd {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:52:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:52:00 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:52:00 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:52:00 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:52:00 user nova-compute[71482]:   <serial>9b294eb4-8109-4d1d-b1a9-da4ff04df141</serial>
Apr 12 09:52:00 user nova-compute[71482]: </disk>
Apr 12 09:52:00 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:52:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:52:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:52:00 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] No VIF found with MAC fa:16:3e:ef:1e:1a, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:52:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-017a9384-f593-44a7-ae8f-b03c5563e796 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.173s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:52:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing instance network info cache due to event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:52:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:52:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:52:03 user nova-compute[71482]: DEBUG nova.network.neutron [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:52:03 user nova-compute[71482]: DEBUG nova.network.neutron [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updated VIF entry in instance network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:52:03 user nova-compute[71482]: DEBUG nova.network.neutron [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:52:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-3181b713-c05b-4f65-87ed-11af036b2a74 req-f4a51b12-5b80-4063-9c52-f9a99dc0f724 service nova] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:52:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:52:05 user nova-compute[71482]: DEBUG nova.compute.manager [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing instance network info cache due to event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:52:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:52:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:52:05 user nova-compute[71482]: DEBUG nova.network.neutron [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:52:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:05 user nova-compute[71482]: INFO nova.compute.manager [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Rebooting instance
Apr 12 09:52:05 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:52:06 user nova-compute[71482]: DEBUG nova.network.neutron [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updated VIF entry in instance network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:52:06 user nova-compute[71482]: DEBUG nova.network.neutron [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:52:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-bbe4a2ed-e01f-4cb4-973f-cf2debf041ae req-bdbfa935-7618-47d2-9afc-c58363fa5ec7 service nova] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:52:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:52:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:52:06 user nova-compute[71482]: DEBUG nova.network.neutron [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:52:06 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:52:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:52:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-unplugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:52:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-unplugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:52:09 user nova-compute[71482]: WARNING nova.compute.manager [req-7b4d8505-8ff8-4b07-9321-e4c4bc7762ae req-f0986ceb-c074-4e06-8b00-a36f2b3f9c34 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-unplugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state active and task_state reboot_started.
Apr 12 09:52:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:09 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Instance shutdown successfully.
Apr 12 09:52:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:10 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:52:11 user nova-compute[71482]: WARNING nova.compute.manager [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state active and task_state reboot_started.
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.compute.manager [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:52:11 user nova-compute[71482]: WARNING nova.compute.manager [req-35a5b2b8-1d55-4458-95a3-0736c63443a2 req-f5309244-5ab9-4bb5-b1bd-c8d299941636 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state active and task_state reboot_started.
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating instance_info_cache with network_info: [{"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:52:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.host [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Removed pending event for 038696c5-53db-4679-b396-2328710f8cdd due to event {{(pid=71482) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681293133.0060236, 038696c5-53db-4679-b396-2328710f8cdd => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:52:13 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] VM Resumed (Lifecycle Event)
Apr 12 09:52:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Instance running successfully.
Apr 12 09:52:13 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Instance soft rebooted successfully.
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:52:13 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681293133.0108542, 038696c5-53db-4679-b396-2328710f8cdd => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:52:13 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] VM Started (Lifecycle Event)
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f62bbf66-e547-421f-9d84-f98b1374fb3f tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.413s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:13 user nova-compute[71482]: DEBUG nova.compute.manager [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:52:13 user nova-compute[71482]: WARNING nova.compute.manager [req-94b11ba4-dbc2-4435-8a20-9f6c602c08d2 req-1d6ea569-2314-4308-865a-fb311ce3a95c service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state active and task_state None.
Apr 12 09:52:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:52:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:52:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:21 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:52:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:52:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:52:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:52:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:52:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:52:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:25 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:52:26 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:52:27 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:52:27 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG nova.objects.instance [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:29 user nova-compute[71482]: INFO nova.compute.manager [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attaching volume 6baf2427-9e28-4917-8705-50963ef3be76 to /dev/vdb
Apr 12 09:52:29 user nova-compute[71482]: DEBUG os_brick.utils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb166d1b-82f5-46eb-926e-55383916e8b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cf004b-babc-41e4-974f-02db2d5de983]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4845ac6c-145e-46f2-a6de-4c272d33a8f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[84670a6b-e00d-4a9f-9914-73e3d7945f1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:52:29 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:52:29 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e6a521-29cb-4660-a54e-e240cd6501af]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG os_brick.utils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:52:29 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating existing volume attachment record: 8c5bf18d-1287-4efa-8a33-9f02b01b607f {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvgOJuHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:52:34 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:52:34 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:52:34 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c696fb43-8924-4a82-981f-229b1dd43348]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:52:34 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d20ceae-e9c5-4792-8039-ee1fdea6da7d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76] added
Apr 12 09:52:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d19c5e-1814-466e-8edc-9074b8c21a9c]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93554de-0770-4207-8be7-bbabfb4ce3a5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvgOJuHe {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qvgOJuHe" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa3864-fda7-42cc-8c16-cf16c0842f77]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qvgOJuHe'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e8a980-5e7e-471e-b1e4-5aaac530dbf3]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fc84a6-e6fa-4662-96d2-d45e31df1e1c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:52:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:52:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f66452-8a0a-4df5-8a81-0560f066f7c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76, portal: 172.16.0.220,3260]
Apr 12 09:52:34 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76, portal: 172.16.0.220,3260] successful.
Apr 12 09:52:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da50e09-436d-4d1e-9ad0-e9a7e34a4d8a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac8a52c-134d-49e5-bf9f-fdca93a40b95]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:52:34 user nova-compute[71482]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 (non-flash)
Apr 12 09:52:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:52:34 user nova-compute[71482]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 (non-flash)
Apr 12 09:52:34 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20740f1-3d1c-4b9e-910e-1338db14c9f2]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvgOJuHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:52:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:52:35 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26531396530613932', 'path': '/dev/sdc'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:52:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531396530613932', 'path': '/dev/sdc'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:52:35 user nova-compute[71482]: DEBUG nova.objects.instance [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:52:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] attach device xml: <disk type="block" device="disk">
Apr 12 09:52:35 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:52:35 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:52:35 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:52:35 user nova-compute[71482]:   <serial>6baf2427-9e28-4917-8705-50963ef3be76</serial>
Apr 12 09:52:35 user nova-compute[71482]: </disk>
Apr 12 09:52:35 user nova-compute[71482]:  {{(pid=71482) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 12 09:52:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:52:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:52:35 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] No VIF found with MAC fa:16:3e:bd:ea:c1, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:52:36 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-4cd28ba0-3923-4aee-9c46-4a0c796365ea tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.400s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:37 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:37 user nova-compute[71482]: INFO nova.compute.manager [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Detaching volume 6baf2427-9e28-4917-8705-50963ef3be76
Apr 12 09:52:38 user nova-compute[71482]: INFO nova.virt.block_device [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Attempting to driver detach volume 6baf2427-9e28-4917-8705-50963ef3be76 from mountpoint /dev/vdb
Apr 12 09:52:38 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:52:38 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8646MB free_disk=26.145771026611328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Attempting to detach device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:52:38 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:52:38 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:52:38 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:52:38 user nova-compute[71482]:   <serial>6baf2427-9e28-4917-8705-50963ef3be76</serial>
Apr 12 09:52:38 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:52:38 user nova-compute[71482]: </disk>
Apr 12 09:52:38 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:52:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully detached device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the persistent domain config.
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:52:38 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:52:38 user nova-compute[71482]:   <source dev="/dev/sdc"/>
Apr 12 09:52:38 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:52:38 user nova-compute[71482]:   <serial>6baf2427-9e28-4917-8705-50963ef3be76</serial>
Apr 12 09:52:38 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:52:38 user nova-compute[71482]: </disk>
Apr 12 09:52:38 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 038696c5-53db-4679-b396-2328710f8cdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681293158.5309496, 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:52:38 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully detached device vdb from instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 from the live domain config.
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qvgOJuHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:52:38 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66feeae-4bb8-4360-adc9-6410f1d0ec84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:52:38 user nova-compute[71482]: No targets found.
Apr 12 09:52:38 user nova-compute[71482]: iSNS:
Apr 12 09:52:38 user nova-compute[71482]: No targets found.
Apr 12 09:52:38 user nova-compute[71482]: STATIC:
Apr 12 09:52:38 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76
Apr 12 09:52:38 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:52:38 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:52:38 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141
Apr 12 09:52:38 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:52:38 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:52:38 user nova-compute[71482]: FIRMWARE:
Apr 12 09:52:38 user nova-compute[71482]: No targets found.
Apr 12 09:52:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:52:38 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:52:38 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef542cf-3bd1-4a82-b889-3d17945a236c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33035a6-6db9-49cc-a233-ae5d8b7b6ce2]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:52:38 user nova-compute[71482]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 (non-flash)
Apr 12 09:52:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:52:38 user nova-compute[71482]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 (non-flash)
Apr 12 09:52:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f933c2aca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76'): ({'sdc'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Removing single pathed devices sdc {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[92046548-95da-4474-9378-04cf280d58b2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6601b43-fd79-402e-8346-ff31e2d8a4b0]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Flushing IO for device /dev/sdc {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11be331-3d76-48b4-967e-8974002fa068]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28bc516-8b53-4fdc-9c27-ff67035f7de2]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] SCSI volumes sdc have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d7b2b5-d197-40f8-95a6-eaa66a64ec01]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[16edf697-fdd3-4146-b481-0457b0d43bcf]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76, portal: 172.16.0.220,3260]
Apr 12 09:52:38 user nova-compute[71482]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76, portal: 172.16.0.220,3260] successful.
Apr 12 09:52:38 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6baf2427-9e28-4917-8705-50963ef3be76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ebc1aa-bb51-4c49-8593-60a3226b09af]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] <== disconnect_volume: return (340ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:52:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:52:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:39 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'flavor' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:52:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a7753179-6f0e-4ad9-92c2-685782ec772f tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.996s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:52:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:52:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:52:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:52:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:52:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:52:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:52:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:52:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:52:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:52:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:52:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:53:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:53:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:53:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:53:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:53:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:53:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:53:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:53:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:53:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:53:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:53:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:53:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:53:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:53:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:53:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:53:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:15 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:53:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:53:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:53:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:53:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:25 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:27 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:29 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:29 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:53:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:53:32 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:38 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:53:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:53:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:53:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=26.144779205322266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 038696c5-53db-4679-b396-2328710f8cdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:53:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received event network-changed-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:53:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Refreshing instance network info cache due to event network-changed-0db4838f-8419-4187-a457-94bb66310863. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:53:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] Acquiring lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:53:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] Acquired lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:53:42 user nova-compute[71482]: DEBUG nova.network.neutron [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Refreshing network info cache for port 0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:53:42 user nova-compute[71482]: DEBUG nova.network.neutron [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updated VIF entry in instance network info cache for port 0db4838f-8419-4187-a457-94bb66310863. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:53:42 user nova-compute[71482]: DEBUG nova.network.neutron [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating instance_info_cache with network_info: [{"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:53:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-21e180f3-6e86-478b-bec7-903d2fc24cee req-26b384ef-196f-4351-a58d-78adb4848f67 service nova] Releasing lock "refresh_cache-98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:53:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:53:45 user nova-compute[71482]: INFO nova.compute.manager [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Terminating instance
Apr 12 09:53:45 user nova-compute[71482]: DEBUG nova.compute.manager [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received event network-vif-unplugged-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] No waiting events found dispatching network-vif-unplugged-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:53:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-acb89fc5-7d7d-4f16-a5e0-d51ff7f59407 req-a1051494-7176-41a5-99c6-7cd0696dc550 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received event network-vif-unplugged-0db4838f-8419-4187-a457-94bb66310863 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:53:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Instance destroyed successfully.
Apr 12 09:53:46 user nova-compute[71482]: DEBUG nova.objects.instance [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lazy-loading 'resources' on Instance uuid 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:47:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-374987338',display_name='tempest-SnapshotDataIntegrityTests-server-374987338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-374987338',id=45,image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFjsDJkKscm/m1JO7QZ595+SiXDjpmpWhJ71MxZtaXRHacQPfxCqvNSfAjwlmPltSXx3TKyV4ATsW49g2lUlMNeiZh5xK2SmbT+BEk5RTvMv1raH8TwLLiSnYkURTu3Iaw==',key_name='tempest-SnapshotDataIntegrityTests-2042005072',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:47:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71345b53304d4b99b233f65d427343ba',ramdisk_id='',reservation_id='r-2009yyvg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4a835d20-3733-4a8b-bebd-54dfa6135dd6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-977295797',owner_user_name='tempest-SnapshotDataIntegrityTests-977295797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:47:32Z,user_data=None,user_id='21416f43494540f2ad0c2e36edd3dc6f',uuid=98f44ec7-7456-4cb7-9f46-bb19adeaa9b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Converting VIF {"id": "0db4838f-8419-4187-a457-94bb66310863", "address": "fa:16:3e:bd:ea:c1", "network": {"id": "610b0245-1993-4002-acd5-0cd5ae10b1a1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-544857552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71345b53304d4b99b233f65d427343ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0db4838f-84", "ovs_interfaceid": "0db4838f-8419-4187-a457-94bb66310863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:ea:c1,bridge_name='br-int',has_traffic_filtering=True,id=0db4838f-8419-4187-a457-94bb66310863,network=Network(610b0245-1993-4002-acd5-0cd5ae10b1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db4838f-84') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG os_vif [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:ea:c1,bridge_name='br-int',has_traffic_filtering=True,id=0db4838f-8419-4187-a457-94bb66310863,network=Network(610b0245-1993-4002-acd5-0cd5ae10b1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db4838f-84') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0db4838f-84, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:53:46 user nova-compute[71482]: INFO os_vif [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:ea:c1,bridge_name='br-int',has_traffic_filtering=True,id=0db4838f-8419-4187-a457-94bb66310863,network=Network(610b0245-1993-4002-acd5-0cd5ae10b1a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0db4838f-84')
Apr 12 09:53:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Deleting instance files /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1_del
Apr 12 09:53:46 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Deletion of /opt/stack/data/nova/instances/98f44ec7-7456-4cb7-9f46-bb19adeaa9b1_del complete
Apr 12 09:53:46 user nova-compute[71482]: INFO nova.compute.manager [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 12 09:53:46 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:53:46 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Took 0.42 seconds to deallocate network for instance.
Apr 12 09:53:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:53:46 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:53:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:53:47 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Deleted allocations for instance 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1
Apr 12 09:53:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-26ddc092-3e85-40ef-bafe-c7716d940379 tempest-SnapshotDataIntegrityTests-977295797 tempest-SnapshotDataIntegrityTests-977295797-project-member] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.919s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:53:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received event network-vif-plugged-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:53:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] Acquiring lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:53:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:53:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] Lock "98f44ec7-7456-4cb7-9f46-bb19adeaa9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:53:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] No waiting events found dispatching network-vif-plugged-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:53:47 user nova-compute[71482]: WARNING nova.compute.manager [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received unexpected event network-vif-plugged-0db4838f-8419-4187-a457-94bb66310863 for instance with vm_state deleted and task_state None.
Apr 12 09:53:47 user nova-compute[71482]: DEBUG nova.compute.manager [req-82eae5f2-9bcd-4e70-a52a-36a0dd2d1cdc req-c50ea987-c711-4916-8ba3-da23bd2f6b45 service nova] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Received event network-vif-deleted-0db4838f-8419-4187-a457-94bb66310863 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:53:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:53:57 user nova-compute[71482]: DEBUG nova.compute.manager [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:53:57 user nova-compute[71482]: DEBUG nova.compute.manager [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing instance network info cache due to event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:53:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:53:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:53:57 user nova-compute[71482]: DEBUG nova.network.neutron [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:53:57 user nova-compute[71482]: DEBUG nova.network.neutron [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updated VIF entry in instance network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:53:57 user nova-compute[71482]: DEBUG nova.network.neutron [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:53:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c0b79aac-bf86-4898-ac57-815598d1490f req-235fe7dd-dbd9-4064-9e99-593a80f3903a service nova] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:53:58 user nova-compute[71482]: INFO nova.compute.manager [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Detaching volume 9b294eb4-8109-4d1d-b1a9-da4ff04df141
Apr 12 09:53:58 user nova-compute[71482]: INFO nova.virt.block_device [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Attempting to driver detach volume 9b294eb4-8109-4d1d-b1a9-da4ff04df141 from mountpoint /dev/vdb
Apr 12 09:53:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Attempting to detach device vdb from instance 038696c5-53db-4679-b396-2328710f8cdd from the persistent domain config. {{(pid=71482) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:53:58 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:53:58 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:53:58 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:53:58 user nova-compute[71482]:   <serial>9b294eb4-8109-4d1d-b1a9-da4ff04df141</serial>
Apr 12 09:53:58 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:53:58 user nova-compute[71482]: </disk>
Apr 12 09:53:58 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:53:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully detached device vdb from instance 038696c5-53db-4679-b396-2328710f8cdd from the persistent domain config.
Apr 12 09:53:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 038696c5-53db-4679-b396-2328710f8cdd from the live domain config. {{(pid=71482) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.guest [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] detach device xml: <disk type="block" device="disk">
Apr 12 09:53:58 user nova-compute[71482]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:53:58 user nova-compute[71482]:   <source dev="/dev/sdb"/>
Apr 12 09:53:58 user nova-compute[71482]:   <target dev="vdb" bus="virtio"/>
Apr 12 09:53:58 user nova-compute[71482]:   <serial>9b294eb4-8109-4d1d-b1a9-da4ff04df141</serial>
Apr 12 09:53:58 user nova-compute[71482]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 12 09:53:58 user nova-compute[71482]: </disk>
Apr 12 09:53:58 user nova-compute[71482]:  {{(pid=71482) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Received event <DeviceRemovedEvent: 1681293238.6843116, 038696c5-53db-4679-b396-2328710f8cdd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71482) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 038696c5-53db-4679-b396-2328710f8cdd {{(pid=71482) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 12 09:53:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully detached device vdb from instance 038696c5-53db-4679-b396-2328710f8cdd from the live domain config.
Apr 12 09:53:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSWPGBQE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:53:58 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d9804-b885-4e2c-a527-06d9f5a6c10f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:53:58 user nova-compute[71482]: No targets found.
Apr 12 09:53:58 user nova-compute[71482]: iSNS:
Apr 12 09:53:58 user nova-compute[71482]: No targets found.
Apr 12 09:53:58 user nova-compute[71482]: STATIC:
Apr 12 09:53:58 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141
Apr 12 09:53:58 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:53:58 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:53:58 user nova-compute[71482]: FIRMWARE:
Apr 12 09:53:58 user nova-compute[71482]: No targets found.
Apr 12 09:53:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:53:58 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:53:58 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cb9def-8a7c-4b9a-8f5a-384e2e013a7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acd2f30-c288-410b-bf19-842db3548aa6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:53:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 (non-flash)
Apr 12 09:53:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9349cd4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee4490c-7b45-4981-b8ab-6f28c7a8a2b6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f074cf-be68-4b08-be9b-fc5fc48f0498]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed25eed-2f5f-4a44-b771-ac91afdf216e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e741cd38-ebd7-492d-8396-c339df76e2b0]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[534495fe-422f-46dc-b433-b9da203177f9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[628f9441-2f0c-4c8c-a07e-463257a4b4b8]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141, portal: 172.16.0.220,3260]
Apr 12 09:53:58 user nova-compute[71482]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141, portal: 172.16.0.220,3260] successful.
Apr 12 09:53:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9b294eb4-8109-4d1d-b1a9-da4ff04df141 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29277a6-7770-4f19-8e68-253f24ca3c9b]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] <== disconnect_volume: return (288ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:53:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG nova.compute.manager [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG nova.compute.manager [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing instance network info cache due to event network-changed-ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG nova.network.neutron [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Refreshing network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG nova.network.neutron [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updated VIF entry in instance network info cache for port ace77f6f-c8a8-4565-b457-95d085efb6f6. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG nova.network.neutron [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1493b9ca-8a87-4d32-8e36-9cfc23069a06 req-9a26640d-52dd-4f81-82b1-96290c8989f5 service nova] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG nova.objects.instance [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'flavor' on Instance uuid 038696c5-53db-4679-b396-2328710f8cdd {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:53:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-088b9456-1b26-4614-800d-5b8a2d14b165 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:01 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681293226.1317327, 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:54:01 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] VM Stopped (Lifecycle Event)
Apr 12 09:54:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f5e46c64-e149-4453-975a-20811c7f602e None None] [instance: 98f44ec7-7456-4cb7-9f46-bb19adeaa9b1] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:54:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid 038696c5-53db-4679-b396-2328710f8cdd {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [{"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-038696c5-53db-4679-b396-2328710f8cdd" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:54:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:54:16 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:54:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:54:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:54:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:54:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:54:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:54:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:54:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:54:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:54:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:54:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:54:27 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:54:29 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:54:31 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:54:31 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:54:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:54:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:54:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:54:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:54:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:54:38 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:54:38 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:54:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=26.16317367553711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 038696c5-53db-4679-b396-2328710f8cdd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:54:38 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:54:39 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:54:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:54:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:54:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:50 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:50 user nova-compute[71482]: INFO nova.compute.manager [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Terminating instance
Apr 12 09:54:50 user nova-compute[71482]: DEBUG nova.compute.manager [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 09:54:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:50 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-unplugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-unplugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG nova.compute.manager [req-5b832cac-3b74-42bc-9eaf-dd6206c17e9e req-cab94884-5b17-4fd0-9473-30740c4ca183 service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-unplugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:51 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Instance destroyed successfully.
Apr 12 09:54:51 user nova-compute[71482]: DEBUG nova.objects.instance [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lazy-loading 'resources' on Instance uuid 038696c5-53db-4679-b396-2328710f8cdd {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:50:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1994871489',display_name='tempest-TestMinimumBasicScenario-server-1994871489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1994871489',id=46,image_ref='98a59b0c-b130-489f-b5f6-1f8372109214',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLnFaeD5GW9hY7Blf+Pjo28Vs1JAT8Z90GiQtJ9zEC7ZRQvTPKDHKGOj7tm4xggd2XKmjB24E2nvfrSxbRu5ogbU+9Fl/0PqUIw50qaxHirma1o6zI0F2bDm2CZnSNpICg==',key_name='tempest-TestMinimumBasicScenario-1594156326',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:50:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='044d0193867a407ba80522df35f5d667',ramdisk_id='',reservation_id='r-6vu00wm5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='98a59b0c-b130-489f-b5f6-1f8372109214',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-935210424',owner_user_name='tempest-TestMinimumBasicScenario-935210424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:52:13Z,user_data=None,user_id='345fff9dd4ce4b74bc87ff29db51e162',uuid=038696c5-53db-4679-b396-2328710f8cdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converting VIF {"id": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "address": "fa:16:3e:ef:1e:1a", "network": {"id": "5d729f24-1410-49e7-9480-31a13a426d8e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1819605467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "044d0193867a407ba80522df35f5d667", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapace77f6f-c8", "ovs_interfaceid": "ace77f6f-c8a8-4565-b457-95d085efb6f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:1e:1a,bridge_name='br-int',has_traffic_filtering=True,id=ace77f6f-c8a8-4565-b457-95d085efb6f6,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace77f6f-c8') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG os_vif [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:1e:1a,bridge_name='br-int',has_traffic_filtering=True,id=ace77f6f-c8a8-4565-b457-95d085efb6f6,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace77f6f-c8') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapace77f6f-c8, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:54:51 user nova-compute[71482]: INFO os_vif [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:1e:1a,bridge_name='br-int',has_traffic_filtering=True,id=ace77f6f-c8a8-4565-b457-95d085efb6f6,network=Network(5d729f24-1410-49e7-9480-31a13a426d8e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapace77f6f-c8')
Apr 12 09:54:51 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Deleting instance files /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd_del
Apr 12 09:54:51 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Deletion of /opt/stack/data/nova/instances/038696c5-53db-4679-b396-2328710f8cdd_del complete
Apr 12 09:54:51 user nova-compute[71482]: INFO nova.compute.manager [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 12 09:54:51 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 09:54:51 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 038696c5-53db-4679-b396-2328710f8cdd] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 09:54:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:54:52 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:54:52 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Took 0.71 seconds to deallocate network for instance.
Apr 12 09:54:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:52 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:54:52 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:54:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:52 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Deleted allocations for instance 038696c5-53db-4679-b396-2328710f8cdd
Apr 12 09:54:52 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-c843f6d2-9e7d-43e2-a11b-3e38be568210 tempest-TestMinimumBasicScenario-935210424 tempest-TestMinimumBasicScenario-935210424-project-member] Lock "038696c5-53db-4679-b396-2328710f8cdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.876s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:54:53 user nova-compute[71482]: WARNING nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state deleted and task_state None.
Apr 12 09:54:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:54:53 user nova-compute[71482]: WARNING nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state deleted and task_state None.
Apr 12 09:54:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:54:53 user nova-compute[71482]: WARNING nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state deleted and task_state None.
Apr 12 09:54:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Acquiring lock "038696c5-53db-4679-b396-2328710f8cdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] Lock "038696c5-53db-4679-b396-2328710f8cdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:54:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] No waiting events found dispatching network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:54:53 user nova-compute[71482]: WARNING nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received unexpected event network-vif-plugged-ace77f6f-c8a8-4565-b457-95d085efb6f6 for instance with vm_state deleted and task_state None.
Apr 12 09:54:53 user nova-compute[71482]: DEBUG nova.compute.manager [req-35c3aebf-01e8-42ae-9976-a8c3dc656991 req-ba7a88a0-16a9-4de4-a1f7-7bb5fd56573a service nova] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Received event network-vif-deleted-ace77f6f-c8a8-4565-b457-95d085efb6f6 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:54:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:55:06 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681293291.491535, 038696c5-53db-4679-b396-2328710f8cdd => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:55:06 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 038696c5-53db-4679-b396-2328710f8cdd] VM Stopped (Lifecycle Event)
Apr 12 09:55:06 user nova-compute[71482]: DEBUG nova.compute.manager [None req-b70690ad-ffd8-46af-a45e-a5b84c752542 None None] [instance: 038696c5-53db-4679-b396-2328710f8cdd] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:55:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:55:11 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:55:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:55:11 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:55:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:55:16 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:55:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:21 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:21 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:26 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:26 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 09:55:26 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 09:55:26 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:55:27 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:29 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:55:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:55:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:55:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:55:31 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:32 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:32 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:55:34 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 09:55:36 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:36 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:37 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:55:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:55:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=26.18195343017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:55:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:55:40 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:55:40 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.479s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:55:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:55:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:55:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:55:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:55:41 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:46 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:51 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:55:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:56 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:55:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:06 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Starting instance... {{(pid=71482) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:56:07 user nova-compute[71482]: INFO nova.compute.claims [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Claim successful on node user
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.176s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Start building networks asynchronously for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Allocating IP information in the background. {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] allocate_for_instance() {{(pid=71482) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 12 09:56:07 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Start building block device mappings for instance. {{(pid=71482) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 12 09:56:07 user nova-compute[71482]: INFO nova.virt.block_device [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Booting with volume 08d398ab-f835-4964-9e8c-06f093ac746e at /dev/vda
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.policy [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cae630b769ab40a3bc9b9664ff51feeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c0fc3ce4eb416da7fe6d87e6bf098e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71482) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG os_brick.utils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4d257a-28e9-4383-a853-4e60919411b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f6a6d6-07f8-402e-8505-1fda70eef3ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da7ed0f-932f-4718-91c6-70bbc2ed8095]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbc29b2-adb5-4096-ae80-3f9bcad051a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:56:07 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:56:07 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5230be-3d36-4a79-ba3b-0106648de6f7]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG os_brick.utils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:56:07 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating existing volume attachment record: af0a6a35-5bd9-4e7d-8a42-06299b241d0e {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:56:08 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Successfully created port: 9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 12 09:56:08 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Successfully updated port: 9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 12 09:56:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:56:08 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:56:08 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG nova.compute.manager [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing instance network info cache due to event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Instance cache missing network info. {{(pid=71482) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG nova.network.neutron [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Instance network_info: |[{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71482) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updated VIF entry in instance network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG nova.network.neutron [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:56:09 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-975af0da-f490-4d03-af73-5aae7c743cf3 req-7f74cfad-3820-4be3-b88c-e03144a0e2ce service nova] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:56:11 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Start spawning the instance on the hypervisor. {{(pid=71482) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:56:12 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Creating image(s)
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Ensure instance console log exists: /opt/stack/data/nova/instances/092fe940-0f21-43d4-a65d-ea9f1c246118/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Start _get_guest_xml network_info=[{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'af0a6a35-5bd9-4e7d-8a42-06299b241d0e', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHUTlBxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '092fe940-0f21-43d4-a65d-ea9f1c246118', 'attached_at': '', 'detached_at': '', 'volume_id': '08d398ab-f835-4964-9e8c-06f093ac746e', 'serial': '08d398ab-f835-4964-9e8c-06f093ac746e'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:56:12 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:56:12 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHUTlBxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:56:12 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:56:12 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:56:12 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e616fa8-8abf-4e79-b032-3c0e2702839d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:56:12 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[be17d78c-a0f1-46ff-ac6d-c9ddff6a3983]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e] added
Apr 12 09:56:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c13296c-46f1-4df3-9310-c0bb3a408ff0]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f26d04a-c94a-4300-977c-173e68c40b43]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHUTlBxR {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHUTlBxR" returned: 0 in 0.025s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00e0fd7-0220-4618-867c-4b0b038aaa8f]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nHUTlBxR'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c34d389-72ba-4e13-bf6b-c058733b345a]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cfa193-329e-49be-9819-8f2002470cda]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:56:12 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:56:12 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:56:12 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:56:12 user nova-compute[71482]: 
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[644d35dc-a622-4f8b-8544-607d681aee3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260]
Apr 12 09:56:12 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260] successful.
Apr 12 09:56:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce56497-9250-4081-a270-9a02fb1d6729]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac383a2-d223-4b5a-a416-68d6474c4dcb]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)
Apr 12 09:56:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)
Apr 12 09:56:12 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef895bc7-ead0-4bf1-8e3b-041b32b12c95]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:56:12 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHUTlBxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Skipping network cache update for instance because it is Building. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26562383736373532', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562383736373532', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1200568600',display_name='tempest-TestShelveInstance-server-1200568600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1200568600',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbIHkLy/ZaS7I86g28/cyDoPMLIqYkiwil20yy/1/mYGQkBUzkCtomC9/9O4wF4HiETVDL+gU3iWDQtjM5Qn6bh1z4IeBZ0KCKrX8IjnLqkuH596ao7cpyWwb66W7mkOQ==',key_name='tempest-TestShelveInstance-1327781575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7c0fc3ce4eb416da7fe6d87e6bf098e',ramdisk_id='',reservation_id='r-ypzlkm8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2080640322',owner_user_name='tempest-TestShelveInstance-2080640322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:56:08Z,user_data=None,user_id='cae630b769ab40a3bc9b9664ff51feeb',uuid=092fe940-0f21-43d4-a65d-ea9f1c246118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converting VIF {"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.objects.instance [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lazy-loading 'pci_devices' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:56:13 user nova-compute[71482]:   <uuid>092fe940-0f21-43d4-a65d-ea9f1c246118</uuid>
Apr 12 09:56:13 user nova-compute[71482]:   <name>instance-0000002f</name>
Apr 12 09:56:13 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:56:13 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:56:13 user nova-compute[71482]:   <metadata>
Apr 12 09:56:13 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:56:13 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:56:13 user nova-compute[71482]:       <nova:name>tempest-TestShelveInstance-server-1200568600</nova:name>
Apr 12 09:56:13 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:56:12</nova:creationTime>
Apr 12 09:56:13 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:56:13 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:56:13 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:56:13 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:56:13 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:56:13 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:56:13 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:56:13 user nova-compute[71482]:       <nova:owner>
Apr 12 09:56:13 user nova-compute[71482]:         <nova:user uuid="cae630b769ab40a3bc9b9664ff51feeb">tempest-TestShelveInstance-2080640322-project-member</nova:user>
Apr 12 09:56:13 user nova-compute[71482]:         <nova:project uuid="d7c0fc3ce4eb416da7fe6d87e6bf098e">tempest-TestShelveInstance-2080640322</nova:project>
Apr 12 09:56:13 user nova-compute[71482]:       </nova:owner>
Apr 12 09:56:13 user nova-compute[71482]:       <nova:ports>
Apr 12 09:56:13 user nova-compute[71482]:         <nova:port uuid="9805333e-4e37-49d1-913c-8c40e5c03c56">
Apr 12 09:56:13 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 09:56:13 user nova-compute[71482]:         </nova:port>
Apr 12 09:56:13 user nova-compute[71482]:       </nova:ports>
Apr 12 09:56:13 user nova-compute[71482]:     </nova:instance>
Apr 12 09:56:13 user nova-compute[71482]:   </metadata>
Apr 12 09:56:13 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:56:13 user nova-compute[71482]:     <system>
Apr 12 09:56:13 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:56:13 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:56:13 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:56:13 user nova-compute[71482]:       <entry name="serial">092fe940-0f21-43d4-a65d-ea9f1c246118</entry>
Apr 12 09:56:13 user nova-compute[71482]:       <entry name="uuid">092fe940-0f21-43d4-a65d-ea9f1c246118</entry>
Apr 12 09:56:13 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:56:13 user nova-compute[71482]:     </system>
Apr 12 09:56:13 user nova-compute[71482]:   </sysinfo>
Apr 12 09:56:13 user nova-compute[71482]:   <os>
Apr 12 09:56:13 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:56:13 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:56:13 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:56:13 user nova-compute[71482]:   </os>
Apr 12 09:56:13 user nova-compute[71482]:   <features>
Apr 12 09:56:13 user nova-compute[71482]:     <acpi/>
Apr 12 09:56:13 user nova-compute[71482]:     <apic/>
Apr 12 09:56:13 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:56:13 user nova-compute[71482]:   </features>
Apr 12 09:56:13 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:56:13 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:56:13 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:56:13 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:56:13 user nova-compute[71482]:   </clock>
Apr 12 09:56:13 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:56:13 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:56:13 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:56:13 user nova-compute[71482]:   </cpu>
Apr 12 09:56:13 user nova-compute[71482]:   <devices>
Apr 12 09:56:13 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:56:13 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:56:13 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:56:13 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:56:13 user nova-compute[71482]:       <serial>08d398ab-f835-4964-9e8c-06f093ac746e</serial>
Apr 12 09:56:13 user nova-compute[71482]:     </disk>
Apr 12 09:56:13 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:56:13 user nova-compute[71482]:       <mac address="fa:16:3e:ba:49:fa"/>
Apr 12 09:56:13 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:56:13 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:56:13 user nova-compute[71482]:       <target dev="tap9805333e-4e"/>
Apr 12 09:56:13 user nova-compute[71482]:     </interface>
Apr 12 09:56:13 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:56:13 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/092fe940-0f21-43d4-a65d-ea9f1c246118/console.log" append="off"/>
Apr 12 09:56:13 user nova-compute[71482]:     </serial>
Apr 12 09:56:13 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:56:13 user nova-compute[71482]:     <video>
Apr 12 09:56:13 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:56:13 user nova-compute[71482]:     </video>
Apr 12 09:56:13 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:56:13 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:56:13 user nova-compute[71482]:     </rng>
Apr 12 09:56:13 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:56:13 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:56:13 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:56:13 user nova-compute[71482]:     </memballoon>
Apr 12 09:56:13 user nova-compute[71482]:   </devices>
Apr 12 09:56:13 user nova-compute[71482]: </domain>
Apr 12 09:56:13 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1200568600',display_name='tempest-TestShelveInstance-server-1200568600',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1200568600',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbIHkLy/ZaS7I86g28/cyDoPMLIqYkiwil20yy/1/mYGQkBUzkCtomC9/9O4wF4HiETVDL+gU3iWDQtjM5Qn6bh1z4IeBZ0KCKrX8IjnLqkuH596ao7cpyWwb66W7mkOQ==',key_name='tempest-TestShelveInstance-1327781575',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7c0fc3ce4eb416da7fe6d87e6bf098e',ramdisk_id='',reservation_id='r-ypzlkm8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2080640322',owner_user_name='tempest-TestShelveInstance-2080640322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-12T09:56:08Z,user_data=None,user_id='cae630b769ab40a3bc9b9664ff51feeb',uuid=092fe940-0f21-43d4-a65d-ea9f1c246118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converting VIF {"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG os_vif [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9805333e-4e, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9805333e-4e, col_values=(('external_ids', {'iface-id': '9805333e-4e37-49d1-913c-8c40e5c03c56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:49:fa', 'vm-uuid': '092fe940-0f21-43d4-a65d-ea9f1c246118'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:56:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:13 user nova-compute[71482]: INFO os_vif [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e')
Apr 12 09:56:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:56:14 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] No VIF found with MAC fa:16:3e:ba:49:fa, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 09:56:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG nova.compute.manager [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] No waiting events found dispatching network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:56:15 user nova-compute[71482]: WARNING nova.compute.manager [req-d37b2307-d59c-4b7a-bc86-0708285099f5 req-549120d6-7d91-4097-821a-c4e05bb726de service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received unexpected event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 for instance with vm_state building and task_state spawning.
Apr 12 09:56:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:15 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681293377.2992368, 092fe940-0f21-43d4-a65d-ea9f1c246118 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:56:17 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] VM Resumed (Lifecycle Event)
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 09:56:17 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Instance spawned successfully.
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Found default for hw_cdrom_bus of ide {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Found default for hw_disk_bus of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Found default for hw_input_bus of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Found default for hw_pointer_model of None {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Found default for hw_video_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Found default for hw_vif_model of virtio {{(pid=71482) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:56:17 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681293377.300591, 092fe940-0f21-43d4-a65d-ea9f1c246118 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:56:17 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] VM Started (Lifecycle Event)
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 09:56:17 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 09:56:17 user nova-compute[71482]: INFO nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Took 4.87 seconds to spawn the instance on the hypervisor.
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:56:17 user nova-compute[71482]: INFO nova.compute.manager [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Took 10.26 seconds to build instance.
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:56:17 user nova-compute[71482]: DEBUG nova.compute.manager [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] No waiting events found dispatching network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:56:17 user nova-compute[71482]: WARNING nova.compute.manager [req-1fe57dbb-58fc-497d-9f88-f6387cf6eb00 req-057e667c-7001-40a7-af12-23403730271c service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received unexpected event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 for instance with vm_state active and task_state None.
Apr 12 09:56:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-1f27f250-05ca-4a4f-bb3a-38dfbfcc030c tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.361s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:56:18 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:25 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:27 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:27 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:30 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:34 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:34 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:56:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:56:39 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:56:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=26.208995819091797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:56:39 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:56:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:47 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:56:47 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Triggering sync for uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 12 09:56:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:56:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:56:47 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:56:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:56:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:56:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:56:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:57:12 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 09:57:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:57:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:57:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:26 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:28 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:29 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:30 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:35 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:57:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 09:57:41 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:57:41 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:57:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8851MB free_disk=26.208415985107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:57:41 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:57:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:57:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:57:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:57:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:57:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:57:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:57:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:57:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:57:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG nova.compute.manager [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG nova.compute.manager [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing instance network info cache due to event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG nova.network.neutron [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG nova.network.neutron [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updated VIF entry in instance network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG nova.network.neutron [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:57:59 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-990c84aa-2abb-403e-9266-550cdc7d39c3 req-4f539bdd-ecb1-4be9-936e-d598dc45fb19 service nova] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:58:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:58:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:58:00 user nova-compute[71482]: INFO nova.compute.manager [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Shelve offloading
Apr 12 09:58:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:00 user nova-compute[71482]: DEBUG nova.compute.manager [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-unplugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:58:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:58:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:58:00 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:58:00 user nova-compute[71482]: DEBUG nova.compute.manager [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] No waiting events found dispatching network-vif-unplugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:58:00 user nova-compute[71482]: WARNING nova.compute.manager [req-62f03acb-affe-4577-93fc-36df6d32d6d4 req-e3df653a-0566-440d-9e74-83ed66659084 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received unexpected event network-vif-unplugged-9805333e-4e37-49d1-913c-8c40e5c03c56 for instance with vm_state active and task_state shelving.
Apr 12 09:58:01 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Instance destroyed successfully.
Apr 12 09:58:01 user nova-compute[71482]: DEBUG nova.compute.manager [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:58:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:58:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:58:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:58:01 user nova-compute[71482]: DEBUG nova.network.neutron [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:58:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:58:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Instance destroyed successfully.
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lazy-loading 'resources' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-12T09:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1200568600',display_name='tempest-TestShelveInstance-server-1200568600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1200568600',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbIHkLy/ZaS7I86g28/cyDoPMLIqYkiwil20yy/1/mYGQkBUzkCtomC9/9O4wF4HiETVDL+gU3iWDQtjM5Qn6bh1z4IeBZ0KCKrX8IjnLqkuH596ao7cpyWwb66W7mkOQ==',key_name='tempest-TestShelveInstance-1327781575',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7c0fc3ce4eb416da7fe6d87e6bf098e',ramdisk_id='',reservation_id='r-ypzlkm8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2080640322',owner_user_name='tempest-TestShelveInstance-2080640322-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:56:17Z,user_data=None,user_id='cae630b769ab40a3bc9b9664ff51feeb',uuid=092fe940-0f21-43d4-a65d-ea9f1c246118,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converting VIF {"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_vif [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9805333e-4e, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:02 user nova-compute[71482]: INFO os_vif [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e')
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHUTlBxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:58:02 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea0adf6-5f11-4b45-aef3-fc00b0ba6365]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 09:58:02 user nova-compute[71482]: No targets found.
Apr 12 09:58:02 user nova-compute[71482]: iSNS:
Apr 12 09:58:02 user nova-compute[71482]: No targets found.
Apr 12 09:58:02 user nova-compute[71482]: STATIC:
Apr 12 09:58:02 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e
Apr 12 09:58:02 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 09:58:02 user nova-compute[71482]:                 Iface Name: default
Apr 12 09:58:02 user nova-compute[71482]: FIRMWARE:
Apr 12 09:58:02 user nova-compute[71482]: No targets found.
Apr 12 09:58:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 09:58:02 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 09:58:02 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9fec0e-690a-4401-8e9c-571afb20a282]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a91ff33-e6e9-4eb8-91f2-5ee511f923be]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)
Apr 12 09:58:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)
Apr 12 09:58:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f930859cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59ea824-c3ee-46f7-8111-d9270b3d183a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[475807b9-4b6a-4a91-820e-bf073d88ffbb]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f7d5ba-8f49-4de7-aebf-754308548862]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[46007e88-d76f-40a5-bde5-08a2d0be1372]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de1f22b-4468-4a25-ae74-7ba49aa96de9]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[163ff6d1-3d67-47ab-b78f-45e8dab4eef1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260]
Apr 12 09:58:02 user nova-compute[71482]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260] successful.
Apr 12 09:58:02 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48d8980-dbf4-4ca9-b08e-da0a7b973438]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] <== disconnect_volume: return (280ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 09:58:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Deleting instance files /opt/stack/data/nova/instances/092fe940-0f21-43d4-a65d-ea9f1c246118_del
Apr 12 09:58:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Deletion of /opt/stack/data/nova/instances/092fe940-0f21-43d4-a65d-ea9f1c246118_del complete
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] No waiting events found dispatching network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 09:58:02 user nova-compute[71482]: WARNING nova.compute.manager [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received unexpected event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 for instance with vm_state active and task_state shelving.
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.compute.manager [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing instance network info cache due to event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:58:02 user nova-compute[71482]: DEBUG nova.network.neutron [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:58:03 user nova-compute[71482]: DEBUG nova.network.neutron [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updated VIF entry in instance network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:58:03 user nova-compute[71482]: DEBUG nova.network.neutron [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": null, "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9805333e-4e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:58:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-eff9f902-c302-4449-8836-cad7d42a6e2f req-82bc5e4f-6e86-45a3-bb51-183952a3a530 service nova] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:58:03 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Deleted allocations for instance 092fe940-0f21-43d4-a65d-ea9f1c246118
Apr 12 09:58:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:58:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:58:03 user nova-compute[71482]: DEBUG nova.objects.instance [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lazy-loading 'numa_topology' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:58:03 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:58:03 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:58:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.103s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:58:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-a5d46abe-b7df-456a-ba06-e9c74db9ff4e tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.480s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:58:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:14 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:58:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:58:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:58:14 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:58:16 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681293481.161361, 092fe940-0f21-43d4-a65d-ea9f1c246118 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 09:58:16 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] VM Stopped (Lifecycle Event)
Apr 12 09:58:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-1d373eb5-71fa-4ef2-a626-1efec03717ae None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 09:58:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:58:22 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:58:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:58:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:27 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:58:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:28 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:58:30 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:58:32 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:58:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:58:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:35 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:58:35 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:58:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:42 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:58:42 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:58:42 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=26.199710845947266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:58:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:58:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:58:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:58:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:58:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:58:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:58:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:58:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:02 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:59:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:07 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:12 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:16 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 09:59:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 09:59:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 09:59:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:59:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:17 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:22 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:23 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:23 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:27 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:59:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:27 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:30 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:30 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:59:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:32 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:34 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:37 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:37 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 09:59:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:59:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 09:59:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 09:59:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 09:59:43 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:59:43 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:59:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=26.19916534423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 09:59:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:59:47 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:59:51 user nova-compute[71482]: INFO nova.compute.manager [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Unshelving
Apr 12 09:59:51 user nova-compute[71482]: INFO nova.virt.block_device [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Booting with volume 08d398ab-f835-4964-9e8c-06f093ac746e at /dev/vda
Apr 12 09:59:51 user nova-compute[71482]: DEBUG os_brick.utils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[0679496a-bdfb-4d12-8f2e-d807476a3cf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:28876217eb7d\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19bf0a4-ec2f-4874-84c2-82e11981e1b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0f7a93-b803-4970-bcb0-d3519d563d0a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f3164a-aa8f-4abc-a4f0-844479f98b45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:51 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Running cmd (subprocess): nvme version {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] 'nvme version' failed. Not Retrying. {{(pid=71482) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.nvmeof [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] nvme not present on system {{(pid=71482) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 12 09:59:52 user nova-compute[71482]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 12 09:59:52 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3860d86-4f33-4dbe-8362-dcba563ccb41]: (4, '') {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71482) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.lightos [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] LIGHTOS: no hostnqn found. {{(pid=71482) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG os_brick.utils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:28876217eb7d', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG nova.virt.block_device [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating existing volume attachment record: a43f67ad-a4d5-4dd0-a16e-9498deb7308e {{(pid=71482) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 12 09:59:52 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:59:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:59:56 user nova-compute[71482]: DEBUG nova.objects.instance [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lazy-loading 'pci_requests' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:59:56 user nova-compute[71482]: DEBUG nova.objects.instance [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lazy-loading 'numa_topology' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:59:56 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71482) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 12 09:59:56 user nova-compute[71482]: INFO nova.compute.claims [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Claim successful on node user
Apr 12 09:59:56 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 09:59:56 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 09:59:56 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:59:57 user nova-compute[71482]: INFO nova.network.neutron [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating port 9805333e-4e37-49d1-913c-8c40e5c03c56 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 12 09:59:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:57 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:59:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:59:57 user nova-compute[71482]: DEBUG nova.network.neutron [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Building network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 12 09:59:57 user nova-compute[71482]: DEBUG nova.compute.manager [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 09:59:57 user nova-compute[71482]: DEBUG nova.compute.manager [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing instance network info cache due to event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 09:59:57 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.network.neutron [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Creating instance directory {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 12 09:59:58 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Creating image(s)
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Did not create local disks {{(pid=71482) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Ensure instance console log exists: /opt/stack/data/nova/instances/092fe940-0f21-43d4-a65d-ea9f1c246118/console.log {{(pid=71482) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Start _get_guest_xml network_info=[{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a43f67ad-a4d5-4dd0-a16e-9498deb7308e', 'disk_bus': 'virtio', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHUTlBxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '092fe940-0f21-43d4-a65d-ea9f1c246118', 'attached_at': '', 'detached_at': '', 'volume_id': '08d398ab-f835-4964-9e8c-06f093ac746e', 'serial': '08d398ab-f835-4964-9e8c-06f093ac746e'}, 'device_type': 'disk', 'boot_index': 0, 'volume_type': None} {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.network.neutron [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 09:59:58 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:59:58 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71482) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-12T09:06:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Flavor limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Image limits 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Flavor pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Image pref 0:0:0 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71482) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Got 1 possible topologies {{(pid=71482) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.hardware [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71482) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.objects.instance [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Calling os-brick to attach iSCSI Volume {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHUTlBxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 09:59:58 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:59:58 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 09:59:58 user nova-compute[71482]: INFO os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8795d4-fd39-47a5-bbae-ed360c872e3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 12 09:59:58 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --interface default --op new {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bb6a0d-6c95-40fa-a68e-a96be765ec54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e] added\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e] added
Apr 12 09:59:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b06ca6-1132-48c7-877c-66050bddf0a7]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4780b4d1-b2a2-4606-b3e7-67ee4301f4c5]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHUTlBxR {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nHUTlBxR" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeb8233-d53a-4b47-aeb5-193c0194fb6d]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nHUTlBxR'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be66c87-f2ea-45e8-bea4-377e4c0f5e25]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e6890-409f-453e-9b1b-644821bba80c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:59:58 user nova-compute[71482]:  {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 12 09:59:58 user nova-compute[71482]:  {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:59:58 user nova-compute[71482]: WARNING os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 12 09:59:58 user nova-compute[71482]: 
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --login {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ee72c1-c28a-454a-9083-39162846a9f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260]
Apr 12 09:59:58 user nova-compute[71482]: Login to [iface: default, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260] successful.
Apr 12 09:59:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9b33de-81ee-443e-96ab-0ad8a64d5c6c]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0358df2-baaf-4c2b-b337-68bf23063c29]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)
Apr 12 09:59:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)
Apr 12 09:59:58 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Connected to 172.16.0.220:3260 {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=71482) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71482) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff17facf-6676-4c62-a804-96b1a33bdda5]: (4, ('- - 0', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71482) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHUTlBxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71482) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.network.neutron [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updated VIF entry in instance network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG nova.network.neutron [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 09:59:58 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-624962b8-b75d-4795-89d3-9ba6c247f1bf req-e26f891f-3967-41c4-afc3-9ee9c1c3d29f service nova] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26562383736373532', 'path': '/dev/sdb'} {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562383736373532', 'path': '/dev/sdb'} {{(pid=71482) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1200568600',display_name='tempest-TestShelveInstance-server-1200568600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1200568600',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1327781575',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d7c0fc3ce4eb416da7fe6d87e6bf098e',ramdisk_id='',reservation_id='r-ypzlkm8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2080640322',owner_user_name='tempest-TestShelveInstance-2080640322-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:59:52Z,user_data=None,user_id='cae630b769ab40a3bc9b9664ff51feeb',uuid=092fe940-0f21-43d4-a65d-ea9f1c246118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71482) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converting VIF {"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.objects.instance [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lazy-loading 'pci_devices' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] End _get_guest_xml xml=<domain type="kvm">
Apr 12 09:59:59 user nova-compute[71482]:   <uuid>092fe940-0f21-43d4-a65d-ea9f1c246118</uuid>
Apr 12 09:59:59 user nova-compute[71482]:   <name>instance-0000002f</name>
Apr 12 09:59:59 user nova-compute[71482]:   <memory>131072</memory>
Apr 12 09:59:59 user nova-compute[71482]:   <vcpu>1</vcpu>
Apr 12 09:59:59 user nova-compute[71482]:   <metadata>
Apr 12 09:59:59 user nova-compute[71482]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 12 09:59:59 user nova-compute[71482]:       <nova:package version="0.0.0"/>
Apr 12 09:59:59 user nova-compute[71482]:       <nova:name>tempest-TestShelveInstance-server-1200568600</nova:name>
Apr 12 09:59:59 user nova-compute[71482]:       <nova:creationTime>2023-04-12 09:59:58</nova:creationTime>
Apr 12 09:59:59 user nova-compute[71482]:       <nova:flavor name="m1.nano">
Apr 12 09:59:59 user nova-compute[71482]:         <nova:memory>128</nova:memory>
Apr 12 09:59:59 user nova-compute[71482]:         <nova:disk>1</nova:disk>
Apr 12 09:59:59 user nova-compute[71482]:         <nova:swap>0</nova:swap>
Apr 12 09:59:59 user nova-compute[71482]:         <nova:ephemeral>0</nova:ephemeral>
Apr 12 09:59:59 user nova-compute[71482]:         <nova:vcpus>1</nova:vcpus>
Apr 12 09:59:59 user nova-compute[71482]:       </nova:flavor>
Apr 12 09:59:59 user nova-compute[71482]:       <nova:owner>
Apr 12 09:59:59 user nova-compute[71482]:         <nova:user uuid="cae630b769ab40a3bc9b9664ff51feeb">tempest-TestShelveInstance-2080640322-project-member</nova:user>
Apr 12 09:59:59 user nova-compute[71482]:         <nova:project uuid="d7c0fc3ce4eb416da7fe6d87e6bf098e">tempest-TestShelveInstance-2080640322</nova:project>
Apr 12 09:59:59 user nova-compute[71482]:       </nova:owner>
Apr 12 09:59:59 user nova-compute[71482]:       <nova:ports>
Apr 12 09:59:59 user nova-compute[71482]:         <nova:port uuid="9805333e-4e37-49d1-913c-8c40e5c03c56">
Apr 12 09:59:59 user nova-compute[71482]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 12 09:59:59 user nova-compute[71482]:         </nova:port>
Apr 12 09:59:59 user nova-compute[71482]:       </nova:ports>
Apr 12 09:59:59 user nova-compute[71482]:     </nova:instance>
Apr 12 09:59:59 user nova-compute[71482]:   </metadata>
Apr 12 09:59:59 user nova-compute[71482]:   <sysinfo type="smbios">
Apr 12 09:59:59 user nova-compute[71482]:     <system>
Apr 12 09:59:59 user nova-compute[71482]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 12 09:59:59 user nova-compute[71482]:       <entry name="product">OpenStack Nova</entry>
Apr 12 09:59:59 user nova-compute[71482]:       <entry name="version">0.0.0</entry>
Apr 12 09:59:59 user nova-compute[71482]:       <entry name="serial">092fe940-0f21-43d4-a65d-ea9f1c246118</entry>
Apr 12 09:59:59 user nova-compute[71482]:       <entry name="uuid">092fe940-0f21-43d4-a65d-ea9f1c246118</entry>
Apr 12 09:59:59 user nova-compute[71482]:       <entry name="family">Virtual Machine</entry>
Apr 12 09:59:59 user nova-compute[71482]:     </system>
Apr 12 09:59:59 user nova-compute[71482]:   </sysinfo>
Apr 12 09:59:59 user nova-compute[71482]:   <os>
Apr 12 09:59:59 user nova-compute[71482]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 12 09:59:59 user nova-compute[71482]:     <boot dev="hd"/>
Apr 12 09:59:59 user nova-compute[71482]:     <smbios mode="sysinfo"/>
Apr 12 09:59:59 user nova-compute[71482]:   </os>
Apr 12 09:59:59 user nova-compute[71482]:   <features>
Apr 12 09:59:59 user nova-compute[71482]:     <acpi/>
Apr 12 09:59:59 user nova-compute[71482]:     <apic/>
Apr 12 09:59:59 user nova-compute[71482]:     <vmcoreinfo/>
Apr 12 09:59:59 user nova-compute[71482]:   </features>
Apr 12 09:59:59 user nova-compute[71482]:   <clock offset="utc">
Apr 12 09:59:59 user nova-compute[71482]:     <timer name="pit" tickpolicy="delay"/>
Apr 12 09:59:59 user nova-compute[71482]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 12 09:59:59 user nova-compute[71482]:     <timer name="hpet" present="no"/>
Apr 12 09:59:59 user nova-compute[71482]:   </clock>
Apr 12 09:59:59 user nova-compute[71482]:   <cpu mode="custom" match="exact">
Apr 12 09:59:59 user nova-compute[71482]:     <model>Nehalem</model>
Apr 12 09:59:59 user nova-compute[71482]:     <topology sockets="1" cores="1" threads="1"/>
Apr 12 09:59:59 user nova-compute[71482]:   </cpu>
Apr 12 09:59:59 user nova-compute[71482]:   <devices>
Apr 12 09:59:59 user nova-compute[71482]:     <disk type="block" device="disk">
Apr 12 09:59:59 user nova-compute[71482]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 12 09:59:59 user nova-compute[71482]:       <source dev="/dev/sdb"/>
Apr 12 09:59:59 user nova-compute[71482]:       <target dev="vda" bus="virtio"/>
Apr 12 09:59:59 user nova-compute[71482]:       <serial>08d398ab-f835-4964-9e8c-06f093ac746e</serial>
Apr 12 09:59:59 user nova-compute[71482]:     </disk>
Apr 12 09:59:59 user nova-compute[71482]:     <interface type="ethernet">
Apr 12 09:59:59 user nova-compute[71482]:       <mac address="fa:16:3e:ba:49:fa"/>
Apr 12 09:59:59 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:59:59 user nova-compute[71482]:       <mtu size="1442"/>
Apr 12 09:59:59 user nova-compute[71482]:       <target dev="tap9805333e-4e"/>
Apr 12 09:59:59 user nova-compute[71482]:     </interface>
Apr 12 09:59:59 user nova-compute[71482]:     <serial type="pty">
Apr 12 09:59:59 user nova-compute[71482]:       <log file="/opt/stack/data/nova/instances/092fe940-0f21-43d4-a65d-ea9f1c246118/console.log" append="off"/>
Apr 12 09:59:59 user nova-compute[71482]:     </serial>
Apr 12 09:59:59 user nova-compute[71482]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 12 09:59:59 user nova-compute[71482]:     <video>
Apr 12 09:59:59 user nova-compute[71482]:       <model type="virtio"/>
Apr 12 09:59:59 user nova-compute[71482]:     </video>
Apr 12 09:59:59 user nova-compute[71482]:     <rng model="virtio">
Apr 12 09:59:59 user nova-compute[71482]:       <backend model="random">/dev/urandom</backend>
Apr 12 09:59:59 user nova-compute[71482]:     </rng>
Apr 12 09:59:59 user nova-compute[71482]:     <controller type="usb" index="0" model="none"/>
Apr 12 09:59:59 user nova-compute[71482]:     <memballoon model="virtio">
Apr 12 09:59:59 user nova-compute[71482]:       <stats period="10"/>
Apr 12 09:59:59 user nova-compute[71482]:     </memballoon>
Apr 12 09:59:59 user nova-compute[71482]:   </devices>
Apr 12 09:59:59 user nova-compute[71482]: </domain>
Apr 12 09:59:59 user nova-compute[71482]:  {{(pid=71482) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1200568600',display_name='tempest-TestShelveInstance-server-1200568600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1200568600',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1327781575',keypairs=<?>,launch_index=0,launched_at=2023-04-12T09:56:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d7c0fc3ce4eb416da7fe6d87e6bf098e',ramdisk_id='',reservation_id='r-ypzlkm8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2080640322',owner_user_name='tempest-TestShelveInstance-2080640322-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T09:59:52Z,user_data=None,user_id='cae630b769ab40a3bc9b9664ff51feeb',uuid=092fe940-0f21-43d4-a65d-ea9f1c246118,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converting VIF {"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG os_vif [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9805333e-4e, may_exist=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9805333e-4e, col_values=(('external_ids', {'iface-id': '9805333e-4e37-49d1-913c-8c40e5c03c56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:49:fa', 'vm-uuid': '092fe940-0f21-43d4-a65d-ea9f1c246118'}),)) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 09:59:59 user nova-compute[71482]: INFO os_vif [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e')
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71482) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 12 09:59:59 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] No VIF found with MAC fa:16:3e:ba:49:fa, not building metadata {{(pid=71482) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 12 10:00:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:00 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:00:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:00:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:00:01 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:00:01 user nova-compute[71482]: DEBUG nova.compute.manager [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] No waiting events found dispatching network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:00:01 user nova-compute[71482]: WARNING nova.compute.manager [req-b4c76645-171e-4691-90a5-0fd551a474f1 req-10639f83-8e33-4a1f-b4ab-9ff7cda48152 service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received unexpected event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 12 10:00:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:01 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:02 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681293602.9322977, 092fe940-0f21-43d4-a65d-ea9f1c246118 => Resumed> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:00:02 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] VM Resumed (Lifecycle Event)
Apr 12 10:00:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Instance event wait completed in 0 seconds for  {{(pid=71482) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 12 10:00:02 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Guest created on hypervisor {{(pid=71482) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 12 10:00:02 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Instance spawned successfully.
Apr 12 10:00:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:00:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:00:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:00:02 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 12 10:00:02 user nova-compute[71482]: DEBUG nova.virt.driver [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] Emitting event <LifecycleEvent: 1681293602.9353101, 092fe940-0f21-43d4-a65d-ea9f1c246118 => Started> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:00:02 user nova-compute[71482]: INFO nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] VM Started (Lifecycle Event)
Apr 12 10:00:02 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:00:03 user nova-compute[71482]: DEBUG nova.compute.manager [None req-8a782f11-7ff3-4c3c-bb2f-3fd355fe8f2a None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71482) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 12 10:00:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-05ae922f-16d5-4dff-b449-df0ddb298ada tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.251s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:00:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:00:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:00:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:00:03 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:00:03 user nova-compute[71482]: DEBUG nova.compute.manager [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] No waiting events found dispatching network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:00:03 user nova-compute[71482]: WARNING nova.compute.manager [req-24004afc-6d72-4691-9346-8c7a9f90af9e req-ed223e45-a097-49cf-911f-4924477aaf2e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received unexpected event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 for instance with vm_state active and task_state None.
Apr 12 10:00:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:00:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:00:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:00:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:00:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:00:16 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:00:16 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:00:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:00:16 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:00:16 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:00:16 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:00:17 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:00:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:00:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:00:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:23 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:28 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:31 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:32 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:33 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:33 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 12 10:00:33 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] There are 0 instances to clean {{(pid=71482) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 12 10:00:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:00:36 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:39 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:39 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:00:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:00:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:00:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:00:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:00:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:40 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71482) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:00:43 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:00:43 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8860MB free_disk=26.197582244873047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing inventories for resource provider bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating ProviderTree inventory for provider bde6c1bb-b134-4972-af52-5525f319b91c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Updating inventory in ProviderTree for provider bde6c1bb-b134-4972-af52-5525f319b91c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing aggregate associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, aggregates: None {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Refreshing trait associations for resource provider bde6c1bb-b134-4972-af52-5525f319b91c, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE41,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=71482) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:00:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:00:44 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:00:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:00:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:49 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:00:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:00:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:00:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:00:54 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:00:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:00:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:00:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:00:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:00:59 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:04 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:01:09 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:01:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:01:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:01:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:01:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:01:14 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Forcefully refreshing network info cache for instance {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG nova.objects.instance [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lazy-loading 'info_cache' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG nova.network.neutron [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:01:17 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updated the network info_cache for instance {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 12 10:01:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:01:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:01:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:01:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:01:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:01:19 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:24 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:25 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:29 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:30 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:31 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:32 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:01:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71482) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 12 10:01:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:01:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71482) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 12 10:01:34 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:36 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:39 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:01:40 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:41 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:41 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG nova.compute.manager [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing instance network info cache due to event network-changed-9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] Acquiring lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] Acquired lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG nova.network.neutron [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Refreshing network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:01:42 user nova-compute[71482]: INFO nova.compute.manager [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Terminating instance
Apr 12 10:01:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Start destroying the instance on the hypervisor. {{(pid=71482) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:42 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-unplugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] No waiting events found dispatching network-vif-unplugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.compute.manager [req-c5735cfb-60a1-4876-ad55-67970aec3fbc req-5dcfd7aa-27c9-400a-a94d-935ade48342e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-unplugged-9805333e-4e37-49d1-913c-8c40e5c03c56 for instance with task_state deleting. {{(pid=71482) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.network.neutron [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updated VIF entry in instance network info cache for port 9805333e-4e37-49d1-913c-8c40e5c03c56. {{(pid=71482) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.network.neutron [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [{"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-332322b4-f11c-422c-af54-e3bc613fe934 req-1a8e102e-c2cb-4de9-8f0d-237f6a020b3e service nova] Releasing lock "refresh_cache-092fe940-0f21-43d4-a65d-ea9f1c246118" {{(pid=71482) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 12 10:01:43 user nova-compute[71482]: INFO nova.virt.libvirt.driver [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Instance destroyed successfully.
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.objects.instance [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lazy-loading 'resources' on Instance uuid 092fe940-0f21-43d4-a65d-ea9f1c246118 {{(pid=71482) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.vif [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-12T09:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1200568600',display_name='tempest-TestShelveInstance-server-1200568600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1200568600',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbIHkLy/ZaS7I86g28/cyDoPMLIqYkiwil20yy/1/mYGQkBUzkCtomC9/9O4wF4HiETVDL+gU3iWDQtjM5Qn6bh1z4IeBZ0KCKrX8IjnLqkuH596ao7cpyWwb66W7mkOQ==',key_name='tempest-TestShelveInstance-1327781575',keypairs=<?>,launch_index=0,launched_at=2023-04-12T10:00:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7c0fc3ce4eb416da7fe6d87e6bf098e',ramdisk_id='',reservation_id='r-ypzlkm8q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2080640322',owner_user_name='tempest-TestShelveInstance-2080640322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-12T10:00:03Z,user_data=None,user_id='cae630b769ab40a3bc9b9664ff51feeb',uuid=092fe940-0f21-43d4-a65d-ea9f1c246118,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converting VIF {"id": "9805333e-4e37-49d1-913c-8c40e5c03c56", "address": "fa:16:3e:ba:49:fa", "network": {"id": "6e59753f-559d-41f9-b8dd-1429c37fd51b", "bridge": "br-int", "label": "tempest-TestShelveInstance-1250457455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c0fc3ce4eb416da7fe6d87e6bf098e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9805333e-4e", "ovs_interfaceid": "9805333e-4e37-49d1-913c-8c40e5c03c56", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.network.os_vif_util [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_vif [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e') {{(pid=71482) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9805333e-4e, bridge=br-int, if_exists=True) {{(pid=71482) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:01:43 user nova-compute[71482]: INFO os_vif [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:49:fa,bridge_name='br-int',has_traffic_filtering=True,id=9805333e-4e37-49d1-913c-8c40e5c03c56,network=Network(6e59753f-559d-41f9-b8dd-1429c37fd51b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9805333e-4e')
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] calling os-brick to detach iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f933c307550>, {'target_iqn': 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nHUTlBxR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 12 10:01:43 user nova-compute[71482]: WARNING os_brick.initiator.connectors.base [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7989e9db-5d3d-4069-b243-2a883b854558]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 12 10:01:43 user nova-compute[71482]: No targets found.
Apr 12 10:01:43 user nova-compute[71482]: iSNS:
Apr 12 10:01:43 user nova-compute[71482]: No targets found.
Apr 12 10:01:43 user nova-compute[71482]: STATIC:
Apr 12 10:01:43 user nova-compute[71482]: Target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e
Apr 12 10:01:43 user nova-compute[71482]:         Portal: 172.16.0.220:3260,-1
Apr 12 10:01:43 user nova-compute[71482]:                 Iface Name: default
Apr 12 10:01:43 user nova-compute[71482]: FIRMWARE:
Apr 12 10:01:43 user nova-compute[71482]: No targets found.
Apr 12 10:01:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 12 10:01:43 user nova-compute[71482]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 12 10:01:43 user nova-compute[71482]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71482) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e', 0)] {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71482) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b316dd2-2d15-427f-af6c-baa138627442]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23c8625-fff9-4803-ae3b-66bde0f70bf2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)
Apr 12 10:01:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e (non-flash)
Apr 12 10:01:43 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f932c283910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e'): ({'sdb'}, set())}) {{(pid=71482) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Removing single pathed devices sdb {{(pid=71482) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:43 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:01:43 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=26.196880340576172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[29522756-9740-4f5d-b466-ff0fae9d9185]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[13633b64-404f-42af-9620-2c20be60e59e]: (4, ('ok\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Flushing IO for device /dev/sdb {{(pid=71482) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f7b193-29f1-4a81-a784-8deecdc9078e]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71482) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Instance 092fe940-0f21-43d4-a65d-ea9f1c246118 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71482) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:01:43 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d47eff1-3924-4c1e-856a-ba90bd4c7f67]: (4, ('1', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG os_brick.initiator.linuxscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] SCSI volumes sdb have been removed. {{(pid=71482) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e')] {{(pid=71482) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.044s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[e548bc67-3475-4f27-aac0-786f1d1c4255]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --logout {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1dafc2-e494-4f17-b81d-f0be31a975eb]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260]
Apr 12 10:01:44 user nova-compute[71482]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e, portal: 172.16.0.220,3260] successful.
Apr 12 10:01:44 user nova-compute[71482]:  stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op delete {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08d398ab-f835-4964-9e8c-06f093ac746e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82392) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cd2337-b1fd-41e5-bf9a-a19c693415b1]: (4, ('', '')) {{(pid=82392) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71482) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.base [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.670s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG os_brick.initiator.connectors.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] <== disconnect_volume: return (670ms) None {{(pid=71482) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Disconnected iSCSI Volume {{(pid=71482) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 12 10:01:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Deleting instance files /opt/stack/data/nova/instances/092fe940-0f21-43d4-a65d-ea9f1c246118_del
Apr 12 10:01:44 user nova-compute[71482]: INFO nova.virt.libvirt.driver [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Deletion of /opt/stack/data/nova/instances/092fe940-0f21-43d4-a65d-ea9f1c246118_del complete
Apr 12 10:01:44 user nova-compute[71482]: INFO nova.compute.manager [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Took 1.51 seconds to destroy the instance on the hypervisor.
Apr 12 10:01:44 user nova-compute[71482]: DEBUG oslo.service.loopingcall [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71482) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG nova.compute.manager [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Deallocating network for instance {{(pid=71482) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] deallocate_for_instance() {{(pid=71482) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 12 10:01:44 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:45 user nova-compute[71482]: DEBUG nova.network.neutron [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Updating instance_info_cache with network_info: [] {{(pid=71482) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 12 10:01:45 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Took 0.86 seconds to deallocate network for instance.
Apr 12 10:01:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:01:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] Acquiring lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:01:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:01:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:01:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] No waiting events found dispatching network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 12 10:01:45 user nova-compute[71482]: WARNING nova.compute.manager [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received unexpected event network-vif-plugged-9805333e-4e37-49d1-913c-8c40e5c03c56 for instance with vm_state active and task_state deleting.
Apr 12 10:01:45 user nova-compute[71482]: DEBUG nova.compute.manager [req-653607b1-9173-4867-9292-3b0e8f25fae5 req-b05be2c8-424b-4d53-b72f-9cc00177affd service nova] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Received event network-vif-deleted-9805333e-4e37-49d1-913c-8c40e5c03c56 {{(pid=71482) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 12 10:01:45 user nova-compute[71482]: INFO nova.compute.manager [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Took 0.80 seconds to detach 1 volumes for instance.
Apr 12 10:01:45 user nova-compute[71482]: DEBUG nova.compute.manager [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Deleting volume: 08d398ab-f835-4964-9e8c-06f093ac746e {{(pid=71482) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 12 10:01:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:01:45 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:01:46 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:01:46 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:01:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:01:46 user nova-compute[71482]: INFO nova.scheduler.client.report [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Deleted allocations for instance 092fe940-0f21-43d4-a65d-ea9f1c246118
Apr 12 10:01:46 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-f97c7ea4-e1a1-442c-9174-6d13d882c550 tempest-TestShelveInstance-2080640322 tempest-TestShelveInstance-2080640322-project-member] Lock "092fe940-0f21-43d4-a65d-ea9f1c246118" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.518s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:01:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:01:58 user nova-compute[71482]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681293703.4529228, 092fe940-0f21-43d4-a65d-ea9f1c246118 => Stopped> {{(pid=71482) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 12 10:01:58 user nova-compute[71482]: INFO nova.compute.manager [-] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] VM Stopped (Lifecycle Event)
Apr 12 10:01:58 user nova-compute[71482]: DEBUG nova.compute.manager [None req-4ff193eb-f141-4631-b0a2-8d554963d8f9 None None] [instance: 092fe940-0f21-43d4-a65d-ea9f1c246118] Checking state {{(pid=71482) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 12 10:01:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:02:03 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:02:08 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:02:13 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:02:18 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:02:20 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:02:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Starting heal instance info cache {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 12 10:02:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Rebuilding the list of instances to heal {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 12 10:02:20 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Didn't find any instances for network info cache update. {{(pid=71482) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 12 10:02:23 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:02:24 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:02:26 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:02:28 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:02:31 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:02:32 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:02:32 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:02:33 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:02:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:02:35 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:02:37 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:02:37 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:02:38 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:02:42 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:02:42 user nova-compute[71482]: DEBUG nova.compute.manager [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71482) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 12 10:02:43 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG oslo_service.periodic_task [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71482) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Auditing locally available compute resources for user (node: user) {{(pid=71482) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 12 10:02:44 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:02:44 user nova-compute[71482]: WARNING nova.virt.libvirt.driver [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 12 10:02:44 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Hypervisor/Node resource view: name=user free_ram=9101MB free_disk=26.19554901123047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71482) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71482) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG nova.compute.provider_tree [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed in ProviderTree for provider: bde6c1bb-b134-4972-af52-5525f319b91c {{(pid=71482) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG nova.scheduler.client.report [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Inventory has not changed for provider bde6c1bb-b134-4972-af52-5525f319b91c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71482) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG nova.compute.resource_tracker [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Compute_service record updated for user:user {{(pid=71482) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 12 10:02:44 user nova-compute[71482]: DEBUG oslo_concurrency.lockutils [None req-0332aed3-241c-4bfe-8a5a-c76abb304ba9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.382s {{(pid=71482) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 12 10:02:48 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:02:53 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 12 10:02:58 user nova-compute[71482]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=71482) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}